2024-04-25T13:09:09.448 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T13:09:09.448 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_leonidus@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --verbose --archive /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467 --name leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/orig.config.yaml 2024-04-25T13:09:09.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:09:09.595 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7673467' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4060 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF/saQmDJyV2hS47JOvNhUK4ffFhbtlhuMj+u3WOLqaqROWnhhuVK4hKnZtmDissiHHtT1DgSRmETNEquqgBGlA= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIS6BIKUzRV+LkT9bLLyOgodTaBBUm/F+1prQJl0xUcFFLpHOJCtUyjVr+nQBmNkQaAQfnk8zmG0nLB+lnQRl7o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_12:17:05 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T13:09:09.595 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa; will attempt to use it 2024-04-25T13:09:09.596 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks 2024-04-25T13:09:09.596 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T13:09:09.598 INFO:teuthology.task.internal:Checking packages... 2024-04-25T13:09:09.619 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T13:09:09.619 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T13:09:09.619 INFO:teuthology.packaging:ref: None 2024-04-25T13:09:09.619 INFO:teuthology.packaging:tag: None 2024-04-25T13:09:09.620 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T13:09:09.620 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:09:09.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T13:09:09.861 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.gd69f13d8 2024-04-25T13:09:09.863 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T13:09:09.874 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T13:09:09.874 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T13:09:09.895 INFO:teuthology.task.internal:Saving configuration 2024-04-25T13:09:09.916 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T13:09:09.926 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:09:09.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.235102', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF/saQmDJyV2hS47JOvNhUK4ffFhbtlhuMj+u3WOLqaqROWnhhuVK4hKnZtmDissiHHtT1DgSRmETNEquqgBGlA='} 2024-04-25T13:09:09.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.236532', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIS6BIKUzRV+LkT9bLLyOgodTaBBUm/F+1prQJl0xUcFFLpHOJCtUyjVr+nQBmNkQaAQfnk8zmG0nLB+lnQRl7o='} 2024-04-25T13:09:09.971 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T13:09:09.982 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T13:09:09.982 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T13:09:09.982 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T13:09:10.059 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe24a8020d0>, signals=[15]) 2024-04-25T13:09:10.059 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T13:09:10.070 INFO:teuthology.task.internal:Opening connections... 2024-04-25T13:09:10.070 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:09:10.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:09:10.148 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:09:10.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:09:10.226 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T13:09:10.235 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-04-25T13:09:10.254 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-04-25T13:09:10.254 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:09:10.311 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:09:10.312 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:09:10.312 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:09:10.312 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-04-25T13:09:10.331 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-25T13:09:10.349 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-25T13:09:10.349 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-25T13:09:10.406 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-25T13:09:10.406 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-25T13:09:10.406 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-25T13:09:10.406 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-25T13:09:10.406 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T13:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T13:09:10.407 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-25T13:09:10.431 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T13:09:10.444 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T13:09:10.453 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T13:09:10.453 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:09:10.456 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:09:10.472 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T13:09:10.481 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T13:09:10.481 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:09:10.512 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:09:10.539 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T13:09:10.599 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T13:09:10.615 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T13:09:10.615 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T13:09:10.616 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:09:10.616 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:09:10.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:10.632 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-04-25T13:09:10.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:10.633 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-25T13:09:10.688 INFO:teuthology.orchestra.run.smithi155.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:09:10.689 INFO:teuthology.task.kernel:Running kernel on smithi155: 5.14.0-437.el9.x86_64 2024-04-25T13:09:10.689 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum install -y kernel 2024-04-25T13:09:10.690 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-437.el9.x86_64 2024-04-25T13:09:10.690 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.14.0-437.el9.x86_64 2024-04-25T13:09:10.690 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2024-04-25T13:09:13.114 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-25T13:09:13.635 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.0 MB 00:01 2024-04-25T13:09:14.957 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-25T13:09:15.620 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-25T13:09:19.174 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-25T13:09:20.747 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-04-25T13:09:22.402 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T13:09:23.778 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.2 MB 00:04 2024-04-25T13:09:26.376 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-25T13:09:27.449 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-25T13:09:28.105 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-25T13:09:29.304 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:09:29.304 INFO:teuthology.orchestra.run.smithi155.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:09:29.398 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T13:09:29.399 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-04-25T13:09:29.399 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-25T13:09:29.495 DEBUG:teuthology.orchestra.run.smithi155:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:09:29.996 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:09:27 PM UTC. 2024-04-25T13:09:30.126 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T13:09:30.141 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout:Reinstalling: 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T13:09:30.142 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:09:30.143 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 255 k 2024-04-25T13:09:30.143 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 0 2024-04-25T13:09:30.143 INFO:teuthology.orchestra.run.smithi155.stderr:Operation aborted. 2024-04-25T13:09:30.206 INFO:teuthology.orchestra.run.smithi155.stdout:Is this ok [y/N]: 2024-04-25T13:09:30.206 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum reinstall -y kernel || true 2024-04-25T13:09:30.703 INFO:teuthology.orchestra.run.smithi155.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:09:27 PM UTC. 2024-04-25T13:09:30.818 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T13:09:30.820 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T13:09:30.821 INFO:teuthology.orchestra.run.smithi155.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:30.821 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T13:09:30.822 INFO:teuthology.orchestra.run.smithi155.stdout:Reinstalling: 2024-04-25T13:09:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:09:30.822 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-25T13:09:30.822 INFO:teuthology.orchestra.run.smithi155.stdout:================================================================================ 2024-04-25T13:09:30.822 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:09:30.823 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 255 k 2024-04-25T13:09:30.823 INFO:teuthology.orchestra.run.smithi155.stdout:Installed size: 0 2024-04-25T13:09:30.823 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-25T13:09:31.017 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-25T13:09:31.017 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:09:31.017 INFO:teuthology.orchestra.run.smithi155.stdout:Total 1.3 MB/s | 255 kB 00:00 2024-04-25T13:09:31.037 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-25T13:09:31.214 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-25T13:09:31.215 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-25T13:09:31.220 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-25T13:09:31.220 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-25T13:09:31.351 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-25T13:09:31.417 INFO:teuthology.orchestra.run.smithi155.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:31.418 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:32.037 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:32.038 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:32.759 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:32.759 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:09:32.759 INFO:teuthology.orchestra.run.smithi155.stdout:Reinstalled: 2024-04-25T13:09:32.760 INFO:teuthology.orchestra.run.smithi155.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:32.760 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:09:32.760 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-25T13:09:32.951 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:09:32.998 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:32.998 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:09:32.999 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:09:32.999 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T13:09:32.999 DEBUG:teuthology.orchestra.run.smithi155:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:09:33.037 INFO:teuthology.orchestra.run.smithi155.stdout:ttyS1 2024-04-25T13:09:33.059 DEBUG:teuthology.parallel:result is None 2024-04-25T13:09:33.186 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-25T13:09:35.067 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T13:09:35.067 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T13:09:35.161 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T13:09:35.162 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-25T13:09:35.162 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-25T13:09:35.278 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2024-04-25T13:09:35.818 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 01:09:33 PM UTC. 2024-04-25T13:09:35.937 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T13:09:35.957 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T13:09:35.957 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:35.957 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T13:09:35.957 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2024-04-25T13:09:35.957 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:35.957 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:09:35.958 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-25T13:09:35.958 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T13:09:35.958 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:09:35.958 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 255 k 2024-04-25T13:09:35.958 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2024-04-25T13:09:35.958 INFO:teuthology.orchestra.run.smithi191.stderr:Operation aborted. 2024-04-25T13:09:36.018 INFO:teuthology.orchestra.run.smithi191.stdout:Is this ok [y/N]: 2024-04-25T13:09:36.018 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2024-04-25T13:09:36.513 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 01:09:33 PM UTC. 2024-04-25T13:09:36.628 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T13:09:36.629 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T13:09:36.629 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-25T13:09:36.629 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T13:09:36.629 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 255 k 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2024-04-25T13:09:36.630 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-25T13:09:37.046 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.7 MB/s | 255 kB 00:00 2024-04-25T13:09:37.046 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:09:37.047 INFO:teuthology.orchestra.run.smithi191.stdout:Total 611 kB/s | 255 kB 00:00 2024-04-25T13:09:37.066 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-25T13:09:37.253 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-25T13:09:37.253 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-25T13:09:37.258 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-25T13:09:37.258 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-25T13:09:37.393 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-25T13:09:37.489 INFO:teuthology.orchestra.run.smithi191.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:37.489 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:38.152 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:38.152 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T13:09:38.826 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T13:09:38.827 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:09:38.827 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalled: 2024-04-25T13:09:38.827 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:38.827 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:09:38.827 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-25T13:09:39.017 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T13:09:39.064 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T13:09:39.065 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T13:09:39.065 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T13:09:39.065 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T13:09:39.065 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T13:09:39.093 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-04-25T13:09:39.114 DEBUG:teuthology.parallel:result is None 2024-04-25T13:09:39.115 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T13:09:39.123 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T13:09:39.123 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:09:39.125 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:09:39.170 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T13:09:39.177 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T13:09:39.187 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T13:09:39.188 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:09:39.190 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:09:39.500 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T13:09:39.508 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T13:09:39.509 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:09:39.511 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:09:39.540 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:39.550 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:39.562 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:39.574 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:09:39.576 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T13:09:39.584 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T13:09:39.584 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:09:39.586 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:09:39.615 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T13:09:39.624 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T13:09:39.624 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:09:39.654 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:09:39.670 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:39.748 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:39.795 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:39.878 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:39.917 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:09:39.918 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:09:39.981 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:40.024 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:09:40.068 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:40.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:09:40.190 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:09:40.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:09:40.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-04-25T13:09:40.260 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-25T13:09:40.299 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:09:40.339 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:09:40.714 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T13:09:40.721 INFO:teuthology.task.internal:Starting timer... 2024-04-25T13:09:40.722 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T13:09:40.733 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T13:09:40.743 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T13:09:40.743 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-04-25T13:09:40.813 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-04-25T13:09:40.814 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-04-25T13:09:40.877 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-04-25T13:09:40.878 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T13:09:40.879 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-04-25T13:09:40.896 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-04-25T13:09:40.896 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-04-25T13:09:40.919 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-04-25T13:09:40.919 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-04-25T13:09:40.919 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:09:40.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:40.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:09:40.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:09:40.985 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T13:09:40.985 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:09:41.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-04-25T13:09:41.063 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T13:09:41.073 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T13:09:41.089 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T13:09:41.096 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi155.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T13:13:10.929 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-25T13:13:10.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T13:13:10.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:13:11.006 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-04-25T13:13:11.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-04-25T13:13:11.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:13:11.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:13:11.160 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-25T13:13:11.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-25T13:13:11.241 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T13:13:11.251 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T13:13:11.251 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:13:11.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:13:11.254 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:13:11.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:13:11.279 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:13:11.293 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:13:11.308 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T13:13:11.314 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-04-25T13:13:11.321 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T13:13:11.324 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-04-25T13:13:11.337 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:13:11.344 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-04-25T13:13:11.350 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:13:11.354 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-04-25T13:13:11.367 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T13:13:11.380 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T13:13:11.405 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:13:11.408 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:13:11.408 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-25T13:13:11.409 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.409 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.409 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.409 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.433 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:13:11.436 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:13:11.436 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-25T13:13:11.436 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.436 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.436 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.436 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:13:11.437 INFO:teuthology.run_tasks:Running task install... 2024-04-25T13:13:11.446 DEBUG:teuthology.task.install:project ceph 2024-04-25T13:13:11.446 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T13:13:11.446 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T13:13:11.446 INFO:teuthology.task.install:Using flavor: default 2024-04-25T13:13:11.452 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T13:13:11.452 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T13:13:11.452 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T13:13:11.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:13:11.454 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T13:13:11.454 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:13:11.680 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T13:13:11.681 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T13:13:11.684 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T13:13:11.684 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T13:13:11.801 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:13:11.801 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:13:11.801 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:13:11.827 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:13:11.827 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:13:11.852 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T13:13:11.852 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:13:11.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T13:13:11.877 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T13:13:11.877 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T13:13:11.893 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:13:11.942 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T13:13:11.963 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:13:12.015 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T13:13:12.026 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-04-25T13:13:12.028 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-04-25T13:13:12.078 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-04-25T13:13:12.079 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-04-25T13:13:12.253 INFO:teuthology.orchestra.run.smithi155.stdout:48 files removed 2024-04-25T13:13:12.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:13:12.302 INFO:teuthology.orchestra.run.smithi191.stdout:48 files removed 2024-04-25T13:13:12.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T13:13:12.945 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 234 kB/s | 83 kB 00:00 2024-04-25T13:13:12.966 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 197 kB/s | 83 kB 00:00 2024-04-25T13:13:13.384 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-25T13:13:13.430 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-04-25T13:13:13.797 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-04-25T13:13:13.859 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-04-25T13:13:14.495 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-25T13:13:16.438 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-25T13:13:19.532 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.0 MB 00:05 2024-04-25T13:13:20.564 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T13:13:21.542 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-25T13:13:22.179 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-25T13:13:24.247 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-25T13:13:25.834 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.2 MB 00:00 2024-04-25T13:13:28.216 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-25T13:13:29.322 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-25T13:13:29.434 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-25T13:13:31.457 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:31.457 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:31.468 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:13:31.468 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:13:31.469 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:13:31.470 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:13:31.471 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:13:31.474 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:13:31.474 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:13:31.534 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:31.544 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T13:13:31.545 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T13:13:31.546 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:13:31.547 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:13:31.548 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:13:31.549 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:13:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:13:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:13:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:13:31.553 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:13:31.554 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout:======================================================================================= 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 4 Packages 2024-04-25T13:13:31.555 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:13:31.556 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 222 M 2024-04-25T13:13:31.556 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-04-25T13:13:32.890 INFO:teuthology.orchestra.run.smithi155.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 16 kB/s | 6.6 kB 00:00 2024-04-25T13:13:33.673 INFO:teuthology.orchestra.run.smithi155.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.1 MB/s | 890 kB 00:00 2024-04-25T13:13:33.815 INFO:teuthology.orchestra.run.smithi155.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 1.0 MB/s | 145 kB 00:00 2024-04-25T13:13:34.501 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-25T13:13:35.240 INFO:teuthology.orchestra.run.smithi155.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 1.7 MB/s | 2.4 MB 00:01 2024-04-25T13:13:36.599 INFO:teuthology.orchestra.run.smithi155.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 1.1 MB/s | 1.5 MB 00:01 2024-04-25T13:13:36.610 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:36.611 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T13:13:36.621 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T13:13:36.622 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T13:13:36.623 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T13:13:36.624 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T13:13:36.625 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T13:13:36.627 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T13:13:36.628 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T13:13:36.690 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T13:13:36.699 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T13:13:36.700 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T13:13:36.701 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T13:13:36.702 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T13:13:36.703 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T13:13:36.704 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T13:13:36.705 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T13:13:36.706 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T13:13:36.707 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T13:13:36.708 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T13:13:36.709 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-25T13:13:36.710 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-25T13:13:36.711 INFO:teuthology.orchestra.run.smithi191.stdout:Install 148 Packages 2024-04-25T13:13:36.711 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 4 Packages 2024-04-25T13:13:36.711 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:13:36.711 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 222 M 2024-04-25T13:13:36.711 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-25T13:13:39.732 INFO:teuthology.orchestra.run.smithi155.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 1.5 MB/s | 4.7 MB 00:03 2024-04-25T13:13:39.957 INFO:teuthology.orchestra.run.smithi155.stdout:(7/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 736 kB/s | 5.4 MB 00:07 2024-04-25T13:13:44.218 INFO:teuthology.orchestra.run.smithi191.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 11 kB/s | 6.6 kB 00:00 2024-04-25T13:13:45.718 INFO:teuthology.orchestra.run.smithi191.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 593 kB/s | 890 kB 00:01 2024-04-25T13:13:45.810 INFO:teuthology.orchestra.run.smithi191.stdout:(3/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 2.5 MB/s | 5.4 MB 00:02 2024-04-25T13:13:45.815 INFO:teuthology.orchestra.run.smithi155.stdout:(8/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x86 2.8 MB/s | 17 MB 00:06 2024-04-25T13:13:45.898 INFO:teuthology.orchestra.run.smithi155.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 303 kB/s | 25 kB 00:00 2024-04-25T13:13:45.985 INFO:teuthology.orchestra.run.smithi191.stdout:(4/152): ceph-immutable-object-cache-19.0.0-315 543 kB/s | 145 kB 00:00 2024-04-25T13:13:46.344 INFO:teuthology.orchestra.run.smithi191.stdout:(5/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 4.4 MB/s | 2.4 MB 00:00 2024-04-25T13:13:47.152 INFO:teuthology.orchestra.run.smithi191.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 5.8 MB/s | 4.7 MB 00:00 2024-04-25T13:13:48.069 INFO:teuthology.orchestra.run.smithi191.stdout:(7/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 735 kB/s | 1.5 MB 00:02 2024-04-25T13:13:48.140 INFO:teuthology.orchestra.run.smithi155.stdout:(10/152): ceph-common-19.0.0-3156.gd69f13d8.el7 1.3 MB/s | 21 MB 00:15 2024-04-25T13:13:48.490 INFO:teuthology.orchestra.run.smithi155.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 643 kB/s | 225 kB 00:00 2024-04-25T13:13:48.599 INFO:teuthology.orchestra.run.smithi155.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 250 kB/s | 27 kB 00:00 2024-04-25T13:13:48.699 INFO:teuthology.orchestra.run.smithi155.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 317 kB/s | 32 kB 00:00 2024-04-25T13:13:50.124 INFO:teuthology.orchestra.run.smithi155.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 524 kB/s | 747 kB 00:01 2024-04-25T13:13:50.491 INFO:teuthology.orchestra.run.smithi155.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 445 kB/s | 163 kB 00:00 2024-04-25T13:13:50.708 INFO:teuthology.orchestra.run.smithi155.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 585 kB/s | 126 kB 00:00 2024-04-25T13:13:50.902 INFO:teuthology.orchestra.run.smithi191.stdout:(8/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x86 4.5 MB/s | 17 MB 00:03 2024-04-25T13:13:50.986 INFO:teuthology.orchestra.run.smithi191.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 303 kB/s | 25 kB 00:00 2024-04-25T13:13:51.367 INFO:teuthology.orchestra.run.smithi155.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 760 kB/s | 500 kB 00:00 2024-04-25T13:13:53.117 INFO:teuthology.orchestra.run.smithi155.stdout:(18/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 824 kB/s | 11 MB 00:13 2024-04-25T13:13:53.250 INFO:teuthology.orchestra.run.smithi155.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 339 kB/s | 45 kB 00:00 2024-04-25T13:13:53.467 INFO:teuthology.orchestra.run.smithi155.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 622 kB/s | 135 kB 00:00 2024-04-25T13:13:53.684 INFO:teuthology.orchestra.run.smithi155.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 745 kB/s | 161 kB 00:00 2024-04-25T13:13:54.067 INFO:teuthology.orchestra.run.smithi155.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 837 kB/s | 320 kB 00:00 2024-04-25T13:13:54.435 INFO:teuthology.orchestra.run.smithi155.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 811 kB/s | 298 kB 00:00 2024-04-25T13:13:54.910 INFO:teuthology.orchestra.run.smithi155.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 209 kB/s | 99 kB 00:00 2024-04-25T13:13:55.219 INFO:teuthology.orchestra.run.smithi155.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 276 kB/s | 85 kB 00:00 2024-04-25T13:13:57.561 INFO:teuthology.orchestra.run.smithi155.stdout:(26/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 886 kB/s | 5.4 MB 00:06 2024-04-25T13:13:57.769 INFO:teuthology.orchestra.run.smithi155.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 819 kB/s | 170 kB 00:00 2024-04-25T13:13:57.878 INFO:teuthology.orchestra.run.smithi155.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 316 kB/s | 34 kB 00:00 2024-04-25T13:13:58.045 INFO:teuthology.orchestra.run.smithi155.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 853 kB/s | 142 kB 00:00 2024-04-25T13:13:58.944 INFO:teuthology.orchestra.run.smithi191.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 997 kB/s | 11 MB 00:10 2024-04-25T13:13:59.218 INFO:teuthology.orchestra.run.smithi191.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 818 kB/s | 225 kB 00:00 2024-04-25T13:13:59.360 INFO:teuthology.orchestra.run.smithi191.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 191 kB/s | 27 kB 00:00 2024-04-25T13:13:59.485 INFO:teuthology.orchestra.run.smithi191.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 254 kB/s | 32 kB 00:00 2024-04-25T13:13:59.861 INFO:teuthology.orchestra.run.smithi155.stdout:(30/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 681 kB/s | 3.1 MB 00:04 2024-04-25T13:14:00.169 INFO:teuthology.orchestra.run.smithi191.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 1.1 MB/s | 747 kB 00:00 2024-04-25T13:14:00.361 INFO:teuthology.orchestra.run.smithi191.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 852 kB/s | 163 kB 00:00 2024-04-25T13:14:00.553 INFO:teuthology.orchestra.run.smithi191.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 660 kB/s | 126 kB 00:00 2024-04-25T13:14:01.029 INFO:teuthology.orchestra.run.smithi191.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 1.0 MB/s | 500 kB 00:00 2024-04-25T13:14:01.245 INFO:teuthology.orchestra.run.smithi155.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 1.1 MB/s | 3.5 MB 00:03 2024-04-25T13:14:01.554 INFO:teuthology.orchestra.run.smithi155.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 808 kB/s | 249 kB 00:00 2024-04-25T13:14:01.670 INFO:teuthology.orchestra.run.smithi155.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 423 kB/s | 49 kB 00:00 2024-04-25T13:14:01.779 INFO:teuthology.orchestra.run.smithi155.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 152 kB/s | 16 kB 00:00 2024-04-25T13:14:02.054 INFO:teuthology.orchestra.run.smithi155.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 994 kB/s | 273 kB 00:00 2024-04-25T13:14:02.679 INFO:teuthology.orchestra.run.smithi155.stdout:(36/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 1.2 MB/s | 762 kB 00:00 2024-04-25T13:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 169 kB/s | 18 kB 00:00 2024-04-25T13:14:02.896 INFO:teuthology.orchestra.run.smithi155.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 743 kB/s | 80 kB 00:00 2024-04-25T13:14:02.972 INFO:teuthology.orchestra.run.smithi155.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2024-04-25T13:14:03.005 INFO:teuthology.orchestra.run.smithi155.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 5.7 MB/s | 195 kB 00:00 2024-04-25T13:14:03.047 INFO:teuthology.orchestra.run.smithi155.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-04-25T13:14:03.106 INFO:teuthology.orchestra.run.smithi155.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 21 MB/s | 1.2 MB 00:00 2024-04-25T13:14:03.139 INFO:teuthology.orchestra.run.smithi155.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-04-25T13:14:03.173 INFO:teuthology.orchestra.run.smithi155.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 4.0 MB/s | 135 kB 00:00 2024-04-25T13:14:03.198 INFO:teuthology.orchestra.run.smithi155.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 4.9 MB/s | 125 kB 00:00 2024-04-25T13:14:03.231 INFO:teuthology.orchestra.run.smithi155.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 6.3 MB/s | 215 kB 00:00 2024-04-25T13:14:03.274 INFO:teuthology.orchestra.run.smithi155.stdout:(47/152): automake-1.16.2-8.el9.noarch.rpm 16 MB/s | 689 kB 00:00 2024-04-25T13:14:03.332 INFO:teuthology.orchestra.run.smithi155.stdout:(48/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T13:14:03.383 INFO:teuthology.orchestra.run.smithi155.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-25T13:14:03.416 INFO:teuthology.orchestra.run.smithi155.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 648 kB/s | 21 kB 00:00 2024-04-25T13:14:03.467 INFO:teuthology.orchestra.run.smithi155.stdout:(51/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T13:14:03.500 INFO:teuthology.orchestra.run.smithi155.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 988 kB/s | 33 kB 00:00 2024-04-25T13:14:03.609 INFO:teuthology.orchestra.run.smithi155.stdout:(53/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-04-25T13:14:03.634 INFO:teuthology.orchestra.run.smithi155.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 729 kB/s | 18 kB 00:00 2024-04-25T13:14:03.659 INFO:teuthology.orchestra.run.smithi155.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 448 kB/s | 11 kB 00:00 2024-04-25T13:14:03.693 INFO:teuthology.orchestra.run.smithi155.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 160 kB 00:00 2024-04-25T13:14:03.718 INFO:teuthology.orchestra.run.smithi155.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 45 kB 00:00 2024-04-25T13:14:03.760 INFO:teuthology.orchestra.run.smithi155.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 662 kB 00:00 2024-04-25T13:14:03.802 INFO:teuthology.orchestra.run.smithi155.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 582 kB 00:00 2024-04-25T13:14:03.812 INFO:teuthology.orchestra.run.smithi191.stdout:(18/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 3.8 MB/s | 49 MB 00:12 2024-04-25T13:14:03.827 INFO:teuthology.orchestra.run.smithi155.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 1.0 MB/s | 25 kB 00:00 2024-04-25T13:14:03.853 INFO:teuthology.orchestra.run.smithi155.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2024-04-25T13:14:03.894 INFO:teuthology.orchestra.run.smithi155.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2024-04-25T13:14:03.928 INFO:teuthology.orchestra.run.smithi155.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 188 kB 00:00 2024-04-25T13:14:03.962 INFO:teuthology.orchestra.run.smithi155.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-04-25T13:14:04.062 INFO:teuthology.orchestra.run.smithi191.stdout:(19/152): ceph-common-19.0.0-3156.gd69f13d8.el7 1.0 MB/s | 21 MB 00:20 2024-04-25T13:14:04.079 INFO:teuthology.orchestra.run.smithi191.stdout:(20/152): python3-ceph-argparse-19.0.0-3156.gd6 169 kB/s | 45 kB 00:00 2024-04-25T13:14:04.104 INFO:teuthology.orchestra.run.smithi155.stdout:(65/152): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-25T13:14:04.238 INFO:teuthology.orchestra.run.smithi155.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-04-25T13:14:04.246 INFO:teuthology.orchestra.run.smithi191.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 968 kB/s | 161 kB 00:00 2024-04-25T13:14:04.297 INFO:teuthology.orchestra.run.smithi191.stdout:(22/152): python3-ceph-common-19.0.0-3156.gd69f 576 kB/s | 135 kB 00:00 2024-04-25T13:14:04.304 INFO:teuthology.orchestra.run.smithi155.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-25T13:14:04.355 INFO:teuthology.orchestra.run.smithi155.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 18 MB/s | 911 kB 00:00 2024-04-25T13:14:04.388 INFO:teuthology.orchestra.run.smithi155.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 3.9 MB/s | 133 kB 00:00 2024-04-25T13:14:04.447 INFO:teuthology.orchestra.run.smithi191.stdout:(23/152): python3-rados-19.0.0-3156.gd69f13d8.e 1.6 MB/s | 320 kB 00:00 2024-04-25T13:14:04.531 INFO:teuthology.orchestra.run.smithi191.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 1.2 MB/s | 99 kB 00:00 2024-04-25T13:14:04.539 INFO:teuthology.orchestra.run.smithi155.stdout:(70/152): postgresql-server-13.14-1.el9.x86_64. 39 MB/s | 5.8 MB 00:00 2024-04-25T13:14:04.556 INFO:teuthology.orchestra.run.smithi191.stdout:(25/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 1.1 MB/s | 298 kB 00:00 2024-04-25T13:14:04.597 INFO:teuthology.orchestra.run.smithi155.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-04-25T13:14:04.614 INFO:teuthology.orchestra.run.smithi191.stdout:(26/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.0 MB/s | 85 kB 00:00 2024-04-25T13:14:04.631 INFO:teuthology.orchestra.run.smithi155.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 2.6 MB/s | 87 kB 00:00 2024-04-25T13:14:04.698 INFO:teuthology.orchestra.run.smithi191.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 2.0 MB/s | 170 kB 00:00 2024-04-25T13:14:04.789 INFO:teuthology.orchestra.run.smithi155.stdout:(73/152): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-04-25T13:14:04.798 INFO:teuthology.orchestra.run.smithi191.stdout:(28/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 1.4 MB/s | 5.4 MB 00:03 2024-04-25T13:14:04.831 INFO:teuthology.orchestra.run.smithi155.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-04-25T13:14:04.848 INFO:teuthology.orchestra.run.smithi191.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3156.g 228 kB/s | 34 kB 00:00 2024-04-25T13:14:04.874 INFO:teuthology.orchestra.run.smithi191.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.9 MB/s | 142 kB 00:00 2024-04-25T13:14:05.232 INFO:teuthology.orchestra.run.smithi155.stdout:(75/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 2.5 MB/s | 49 MB 00:19 2024-04-25T13:14:05.257 INFO:teuthology.orchestra.run.smithi155.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 583 kB/s | 248 kB 00:00 2024-04-25T13:14:05.282 INFO:teuthology.orchestra.run.smithi155.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 518 kB/s | 26 kB 00:00 2024-04-25T13:14:05.307 INFO:teuthology.orchestra.run.smithi155.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-04-25T13:14:05.333 INFO:teuthology.orchestra.run.smithi155.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-25T13:14:05.360 INFO:teuthology.orchestra.run.smithi155.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 670 kB/s | 35 kB 00:00 2024-04-25T13:14:05.452 INFO:teuthology.orchestra.run.smithi155.stdout:(81/152): ceph-mgr-diskprediction-local-19.0.0- 1.3 MB/s | 7.4 MB 00:05 2024-04-25T13:14:05.536 INFO:teuthology.orchestra.run.smithi155.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-04-25T13:14:05.561 INFO:teuthology.orchestra.run.smithi155.stdout:(83/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 250 kB 00:00 2024-04-25T13:14:05.583 INFO:teuthology.orchestra.run.smithi191.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 4.8 MB/s | 3.5 MB 00:00 2024-04-25T13:14:05.586 INFO:teuthology.orchestra.run.smithi155.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-04-25T13:14:05.611 INFO:teuthology.orchestra.run.smithi155.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-25T13:14:05.628 INFO:teuthology.orchestra.run.smithi155.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 639 kB/s | 42 kB 00:00 2024-04-25T13:14:05.653 INFO:teuthology.orchestra.run.smithi155.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-04-25T13:14:05.666 INFO:teuthology.orchestra.run.smithi191.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 2.9 MB/s | 249 kB 00:00 2024-04-25T13:14:05.679 INFO:teuthology.orchestra.run.smithi155.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T13:14:05.704 INFO:teuthology.orchestra.run.smithi155.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T13:14:05.720 INFO:teuthology.orchestra.run.smithi155.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 772 kB/s | 51 kB 00:00 2024-04-25T13:14:05.733 INFO:teuthology.orchestra.run.smithi191.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 740 kB/s | 49 kB 00:00 2024-04-25T13:14:05.737 INFO:teuthology.orchestra.run.smithi155.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-04-25T13:14:05.792 INFO:teuthology.orchestra.run.smithi191.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 283 kB/s | 16 kB 00:00 2024-04-25T13:14:05.863 INFO:teuthology.orchestra.run.smithi155.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 296 kB/s | 42 kB 00:00 2024-04-25T13:14:05.913 INFO:teuthology.orchestra.run.smithi155.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 257 kB/s | 44 kB 00:00 2024-04-25T13:14:05.925 INFO:teuthology.orchestra.run.smithi191.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 2.0 MB/s | 273 kB 00:00 2024-04-25T13:14:06.097 INFO:teuthology.orchestra.run.smithi155.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-04-25T13:14:06.122 INFO:teuthology.orchestra.run.smithi155.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 863 kB/s | 221 kB 00:00 2024-04-25T13:14:06.134 INFO:teuthology.orchestra.run.smithi191.stdout:(36/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 3.6 MB/s | 762 kB 00:00 2024-04-25T13:14:06.147 INFO:teuthology.orchestra.run.smithi155.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 155 kB/s | 36 kB 00:00 2024-04-25T13:14:06.172 INFO:teuthology.orchestra.run.smithi155.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 634 kB/s | 47 kB 00:00 2024-04-25T13:14:06.206 INFO:teuthology.orchestra.run.smithi155.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T13:14:06.217 INFO:teuthology.orchestra.run.smithi191.stdout:(37/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 1.9 MB/s | 3.1 MB 00:01 2024-04-25T13:14:06.231 INFO:teuthology.orchestra.run.smithi155.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 693 kB/s | 58 kB 00:00 2024-04-25T13:14:06.243 INFO:teuthology.orchestra.run.smithi191.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 168 kB/s | 18 kB 00:00 2024-04-25T13:14:06.256 INFO:teuthology.orchestra.run.smithi155.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-04-25T13:14:06.282 INFO:teuthology.orchestra.run.smithi155.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 850 kB/s | 64 kB 00:00 2024-04-25T13:14:06.307 INFO:teuthology.orchestra.run.smithi155.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-04-25T13:14:06.332 INFO:teuthology.orchestra.run.smithi155.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-04-25T13:14:06.365 INFO:teuthology.orchestra.run.smithi155.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-04-25T13:14:06.376 INFO:teuthology.orchestra.run.smithi191.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-04-25T13:14:06.427 INFO:teuthology.orchestra.run.smithi191.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-25T13:14:06.477 INFO:teuthology.orchestra.run.smithi191.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-25T13:14:06.561 INFO:teuthology.orchestra.run.smithi191.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-04-25T13:14:06.603 INFO:teuthology.orchestra.run.smithi191.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-25T13:14:06.628 INFO:teuthology.orchestra.run.smithi191.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T13:14:06.653 INFO:teuthology.orchestra.run.smithi191.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T13:14:06.679 INFO:teuthology.orchestra.run.smithi191.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T13:14:06.704 INFO:teuthology.orchestra.run.smithi191.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T13:14:06.729 INFO:teuthology.orchestra.run.smithi191.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 14 MB/s | 689 kB 00:00 2024-04-25T13:14:06.757 INFO:teuthology.orchestra.run.smithi155.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 50 kB/s | 19 kB 00:00 2024-04-25T13:14:06.763 INFO:teuthology.orchestra.run.smithi191.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T13:14:06.788 INFO:teuthology.orchestra.run.smithi191.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T13:14:06.805 INFO:teuthology.orchestra.run.smithi191.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 516 kB/s | 21 kB 00:00 2024-04-25T13:14:06.831 INFO:teuthology.orchestra.run.smithi191.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-04-25T13:14:06.847 INFO:teuthology.orchestra.run.smithi191.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 792 kB/s | 33 kB 00:00 2024-04-25T13:14:06.931 INFO:teuthology.orchestra.run.smithi191.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-04-25T13:14:06.948 INFO:teuthology.orchestra.run.smithi191.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 183 kB/s | 18 kB 00:00 2024-04-25T13:14:06.965 INFO:teuthology.orchestra.run.smithi191.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-04-25T13:14:06.990 INFO:teuthology.orchestra.run.smithi191.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-04-25T13:14:07.016 INFO:teuthology.orchestra.run.smithi191.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-04-25T13:14:07.041 INFO:teuthology.orchestra.run.smithi191.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-04-25T13:14:07.049 INFO:teuthology.orchestra.run.smithi155.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 431 kB/s | 309 kB 00:00 2024-04-25T13:14:07.066 INFO:teuthology.orchestra.run.smithi191.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 582 kB 00:00 2024-04-25T13:14:07.092 INFO:teuthology.orchestra.run.smithi191.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 518 kB/s | 25 kB 00:00 2024-04-25T13:14:07.116 INFO:teuthology.orchestra.run.smithi155.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 700 kB/s | 548 kB 00:00 2024-04-25T13:14:07.117 INFO:teuthology.orchestra.run.smithi191.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-25T13:14:07.142 INFO:teuthology.orchestra.run.smithi191.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-25T13:14:07.150 INFO:teuthology.orchestra.run.smithi155.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-25T13:14:07.168 INFO:teuthology.orchestra.run.smithi191.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T13:14:07.193 INFO:teuthology.orchestra.run.smithi191.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 708 kB/s | 35 kB 00:00 2024-04-25T13:14:07.217 INFO:teuthology.orchestra.run.smithi155.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-04-25T13:14:07.259 INFO:teuthology.orchestra.run.smithi155.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2024-04-25T13:14:07.310 INFO:teuthology.orchestra.run.smithi191.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-25T13:14:07.334 INFO:teuthology.orchestra.run.smithi155.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-25T13:14:07.394 INFO:teuthology.orchestra.run.smithi191.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-25T13:14:07.427 INFO:teuthology.orchestra.run.smithi191.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-25T13:14:07.461 INFO:teuthology.orchestra.run.smithi191.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 911 kB 00:00 2024-04-25T13:14:07.486 INFO:teuthology.orchestra.run.smithi191.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-25T13:14:07.501 INFO:teuthology.orchestra.run.smithi155.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-04-25T13:14:07.535 INFO:teuthology.orchestra.run.smithi155.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-04-25T13:14:07.568 INFO:teuthology.orchestra.run.smithi155.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2024-04-25T13:14:07.602 INFO:teuthology.orchestra.run.smithi155.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2024-04-25T13:14:07.603 INFO:teuthology.orchestra.run.smithi191.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 8.8 MB/s | 1.0 MB 00:00 2024-04-25T13:14:07.636 INFO:teuthology.orchestra.run.smithi155.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 320 kB/s | 32 kB 00:00 2024-04-25T13:14:07.669 INFO:teuthology.orchestra.run.smithi155.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-25T13:14:07.678 INFO:teuthology.orchestra.run.smithi191.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-04-25T13:14:07.703 INFO:teuthology.orchestra.run.smithi155.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-25T13:14:07.703 INFO:teuthology.orchestra.run.smithi191.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 878 kB/s | 87 kB 00:00 2024-04-25T13:14:07.761 INFO:teuthology.orchestra.run.smithi155.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-25T13:14:07.786 INFO:teuthology.orchestra.run.smithi155.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-25T13:14:07.796 INFO:teuthology.orchestra.run.smithi191.stdout:(74/152): ceph-mgr-diskprediction-local-19.0.0- 2.5 MB/s | 7.4 MB 00:02 2024-04-25T13:14:07.811 INFO:teuthology.orchestra.run.smithi155.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-04-25T13:14:07.879 INFO:teuthology.orchestra.run.smithi155.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-04-25T13:14:07.896 INFO:teuthology.orchestra.run.smithi191.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-04-25T13:14:07.921 INFO:teuthology.orchestra.run.smithi191.stdout:(76/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-25T13:14:07.945 INFO:teuthology.orchestra.run.smithi155.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-25T13:14:07.946 INFO:teuthology.orchestra.run.smithi191.stdout:(77/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-04-25T13:14:07.963 INFO:teuthology.orchestra.run.smithi191.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 387 kB/s | 26 kB 00:00 2024-04-25T13:14:07.971 INFO:teuthology.orchestra.run.smithi155.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-25T13:14:07.980 INFO:teuthology.orchestra.run.smithi191.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 569 kB/s | 19 kB 00:00 2024-04-25T13:14:08.006 INFO:teuthology.orchestra.run.smithi191.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T13:14:08.023 INFO:teuthology.orchestra.run.smithi191.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-04-25T13:14:08.071 INFO:teuthology.orchestra.run.smithi155.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.2 MB/s | 2.0 MB 00:00 2024-04-25T13:14:08.088 INFO:teuthology.orchestra.run.smithi155.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2024-04-25T13:14:08.105 INFO:teuthology.orchestra.run.smithi155.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 173 kB/s | 23 kB 00:00 2024-04-25T13:14:08.163 INFO:teuthology.orchestra.run.smithi155.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-25T13:14:08.198 INFO:teuthology.orchestra.run.smithi191.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-04-25T13:14:08.205 INFO:teuthology.orchestra.run.smithi155.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2024-04-25T13:14:08.239 INFO:teuthology.orchestra.run.smithi155.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-04-25T13:14:08.256 INFO:teuthology.orchestra.run.smithi155.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-04-25T13:14:08.265 INFO:teuthology.orchestra.run.smithi191.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-04-25T13:14:08.290 INFO:teuthology.orchestra.run.smithi191.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 832 kB/s | 222 kB 00:00 2024-04-25T13:14:08.314 INFO:teuthology.orchestra.run.smithi155.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 725 kB/s | 79 kB 00:00 2024-04-25T13:14:08.315 INFO:teuthology.orchestra.run.smithi191.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 662 kB/s | 77 kB 00:00 2024-04-25T13:14:08.332 INFO:teuthology.orchestra.run.smithi191.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-25T13:14:08.339 INFO:teuthology.orchestra.run.smithi155.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-04-25T13:14:08.357 INFO:teuthology.orchestra.run.smithi191.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-25T13:14:08.373 INFO:teuthology.orchestra.run.smithi155.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-25T13:14:08.382 INFO:teuthology.orchestra.run.smithi191.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-25T13:14:08.399 INFO:teuthology.orchestra.run.smithi191.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-04-25T13:14:08.415 INFO:teuthology.orchestra.run.smithi155.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-25T13:14:08.425 INFO:teuthology.orchestra.run.smithi191.stdout:(90/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-25T13:14:08.432 INFO:teuthology.orchestra.run.smithi155.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 977 kB/s | 90 kB 00:00 2024-04-25T13:14:08.450 INFO:teuthology.orchestra.run.smithi191.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 798 kB/s | 54 kB 00:00 2024-04-25T13:14:08.474 INFO:teuthology.orchestra.run.smithi155.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-04-25T13:14:08.516 INFO:teuthology.orchestra.run.smithi155.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-04-25T13:14:08.549 INFO:teuthology.orchestra.run.smithi155.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-25T13:14:08.574 INFO:teuthology.orchestra.run.smithi155.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-04-25T13:14:08.617 INFO:teuthology.orchestra.run.smithi155.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-04-25T13:14:08.650 INFO:teuthology.orchestra.run.smithi155.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 508 kB/s | 51 kB 00:00 2024-04-25T13:14:08.676 INFO:teuthology.orchestra.run.smithi155.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-25T13:14:08.717 INFO:teuthology.orchestra.run.smithi155.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-04-25T13:14:08.742 INFO:teuthology.orchestra.run.smithi191.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 131 kB/s | 42 kB 00:00 2024-04-25T13:14:08.751 INFO:teuthology.orchestra.run.smithi155.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-04-25T13:14:08.776 INFO:teuthology.orchestra.run.smithi155.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-04-25T13:14:08.826 INFO:teuthology.orchestra.run.smithi155.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-25T13:14:08.868 INFO:teuthology.orchestra.run.smithi191.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 106 kB/s | 44 kB 00:00 2024-04-25T13:14:08.885 INFO:teuthology.orchestra.run.smithi155.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T13:14:08.994 INFO:teuthology.orchestra.run.smithi155.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-25T13:14:09.111 INFO:teuthology.orchestra.run.smithi155.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-25T13:14:09.226 INFO:teuthology.orchestra.run.smithi191.stdout:(94/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-25T13:14:09.251 INFO:teuthology.orchestra.run.smithi191.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 435 kB/s | 221 kB 00:00 2024-04-25T13:14:09.277 INFO:teuthology.orchestra.run.smithi191.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 88 kB/s | 36 kB 00:00 2024-04-25T13:14:09.302 INFO:teuthology.orchestra.run.smithi191.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 636 kB/s | 47 kB 00:00 2024-04-25T13:14:09.327 INFO:teuthology.orchestra.run.smithi191.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-25T13:14:09.352 INFO:teuthology.orchestra.run.smithi191.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 771 kB/s | 58 kB 00:00 2024-04-25T13:14:09.377 INFO:teuthology.orchestra.run.smithi191.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-04-25T13:14:09.403 INFO:teuthology.orchestra.run.smithi191.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-04-25T13:14:09.428 INFO:teuthology.orchestra.run.smithi191.stdout:(102/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-04-25T13:14:09.453 INFO:teuthology.orchestra.run.smithi191.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-04-25T13:14:09.487 INFO:teuthology.orchestra.run.smithi191.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-04-25T13:14:09.537 INFO:teuthology.orchestra.run.smithi191.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 391 kB/s | 19 kB 00:00 2024-04-25T13:14:09.596 INFO:teuthology.orchestra.run.smithi191.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 2.1 MB/s | 309 kB 00:00 2024-04-25T13:14:09.630 INFO:teuthology.orchestra.run.smithi191.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 3.1 MB/s | 548 kB 00:00 2024-04-25T13:14:09.655 INFO:teuthology.orchestra.run.smithi191.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-04-25T13:14:09.680 INFO:teuthology.orchestra.run.smithi191.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-04-25T13:14:09.705 INFO:teuthology.orchestra.run.smithi191.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-25T13:14:09.731 INFO:teuthology.orchestra.run.smithi191.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-04-25T13:14:09.773 INFO:teuthology.orchestra.run.smithi191.stdout:(112/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-04-25T13:14:09.798 INFO:teuthology.orchestra.run.smithi191.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-04-25T13:14:09.823 INFO:teuthology.orchestra.run.smithi191.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-04-25T13:14:09.849 INFO:teuthology.orchestra.run.smithi191.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-04-25T13:14:09.869 INFO:teuthology.orchestra.run.smithi155.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 3.1 MB/s | 3.4 MB 00:01 2024-04-25T13:14:09.874 INFO:teuthology.orchestra.run.smithi191.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-25T13:14:09.899 INFO:teuthology.orchestra.run.smithi191.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-04-25T13:14:09.924 INFO:teuthology.orchestra.run.smithi191.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-04-25T13:14:10.025 INFO:teuthology.orchestra.run.smithi191.stdout:(119/152): libarrow-9.0.0-10.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-25T13:14:10.050 INFO:teuthology.orchestra.run.smithi191.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-04-25T13:14:10.075 INFO:teuthology.orchestra.run.smithi191.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.7 MB/s | 303 kB 00:00 2024-04-25T13:14:10.077 INFO:teuthology.orchestra.run.smithi155.stdout:(152/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 2.5 MB/s | 3.1 MB 00:01 2024-04-25T13:14:10.084 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:14:10.085 INFO:teuthology.orchestra.run.smithi155.stdout:Total 5.8 MB/s | 222 MB 00:38 2024-04-25T13:14:10.100 INFO:teuthology.orchestra.run.smithi191.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-25T13:14:10.126 INFO:teuthology.orchestra.run.smithi191.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-25T13:14:10.143 INFO:teuthology.orchestra.run.smithi191.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-04-25T13:14:10.160 INFO:teuthology.orchestra.run.smithi191.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 526 kB/s | 18 kB 00:00 2024-04-25T13:14:10.177 INFO:teuthology.orchestra.run.smithi191.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 688 kB/s | 23 kB 00:00 2024-04-25T13:14:10.194 INFO:teuthology.orchestra.run.smithi191.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-04-25T13:14:10.211 INFO:teuthology.orchestra.run.smithi191.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-04-25T13:14:10.261 INFO:teuthology.orchestra.run.smithi191.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-04-25T13:14:10.278 INFO:teuthology.orchestra.run.smithi191.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 691 kB/s | 46 kB 00:00 2024-04-25T13:14:10.304 INFO:teuthology.orchestra.run.smithi191.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-04-25T13:14:10.320 INFO:teuthology.orchestra.run.smithi191.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-04-25T13:14:10.354 INFO:teuthology.orchestra.run.smithi191.stdout:(133/152): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-04-25T13:14:10.379 INFO:teuthology.orchestra.run.smithi191.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-04-25T13:14:10.404 INFO:teuthology.orchestra.run.smithi191.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-25T13:14:10.430 INFO:teuthology.orchestra.run.smithi191.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-04-25T13:14:10.455 INFO:teuthology.orchestra.run.smithi191.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-04-25T13:14:10.480 INFO:teuthology.orchestra.run.smithi191.stdout:(138/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-25T13:14:10.505 INFO:teuthology.orchestra.run.smithi191.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-25T13:14:10.539 INFO:teuthology.orchestra.run.smithi191.stdout:(140/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-25T13:14:10.564 INFO:teuthology.orchestra.run.smithi191.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-04-25T13:14:10.593 INFO:teuthology.orchestra.run.smithi191.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 585 kB/s | 51 kB 00:00 2024-04-25T13:14:10.632 INFO:teuthology.orchestra.run.smithi191.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-25T13:14:10.657 INFO:teuthology.orchestra.run.smithi191.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-25T13:14:10.682 INFO:teuthology.orchestra.run.smithi191.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-04-25T13:14:10.707 INFO:teuthology.orchestra.run.smithi191.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-25T13:14:10.758 INFO:teuthology.orchestra.run.smithi191.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-25T13:14:10.904 INFO:teuthology.orchestra.run.smithi191.stdout:(148/152): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-04-25T13:14:11.000 INFO:teuthology.orchestra.run.smithi191.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 14 MB/s | 1.3 MB 00:00 2024-04-25T13:14:11.118 INFO:teuthology.orchestra.run.smithi191.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-04-25T13:14:11.188 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-04-25T13:14:11.334 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-04-25T13:14:11.334 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-04-25T13:14:11.534 INFO:teuthology.orchestra.run.smithi191.stdout:(151/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 4.1 MB/s | 3.1 MB 00:00 2024-04-25T13:14:11.793 INFO:teuthology.orchestra.run.smithi191.stdout:(152/152): librados2-19.0.0-3156.gd69f13d8.el7. 3.1 MB/s | 3.4 MB 00:01 2024-04-25T13:14:11.798 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-25T13:14:11.798 INFO:teuthology.orchestra.run.smithi191.stdout:Total 6.3 MB/s | 222 MB 00:35 2024-04-25T13:14:12.852 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-25T13:14:12.993 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-25T13:14:12.993 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-25T13:14:13.109 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-04-25T13:14:13.109 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-04-25T13:14:14.760 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-25T13:14:14.761 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-25T13:14:19.073 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-04-25T13:14:19.164 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:14:19.202 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:14:19.256 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:14:19.290 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:14:19.317 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:14:19.350 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:14:19.685 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:14:19.791 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:19.896 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:19.927 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:20.016 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:20.047 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:14:20.193 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:14:20.243 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:14:20.271 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:20.374 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:20.397 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:20.460 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:20.473 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:20.497 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:20.685 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-25T13:14:20.690 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:20.722 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:20.763 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T13:14:20.801 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T13:14:20.830 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:14:20.854 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T13:14:20.897 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T13:14:20.923 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T13:14:20.925 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:14:20.963 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:14:20.965 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T13:14:20.998 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:14:21.061 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:14:21.105 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:14:21.148 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:14:21.181 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:14:21.209 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:14:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:14:21.330 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:14:21.348 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T13:14:21.361 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:14:21.397 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:14:21.399 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:21.472 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:14:21.508 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T13:14:21.520 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:14:21.551 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T13:14:21.558 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:21.580 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T13:14:21.649 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:14:21.650 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:14:21.679 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:14:21.702 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:14:21.797 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:14:21.828 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T13:14:21.885 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T13:14:21.913 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:21.933 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:14:21.988 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:14:22.016 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:14:22.039 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:22.101 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T13:14:22.123 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:22.145 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T13:14:22.348 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:22.381 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T13:14:22.489 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T13:14:22.508 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:14:22.584 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T13:14:22.592 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:14:22.621 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:14:22.631 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T13:14:22.664 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:14:22.665 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T13:14:22.702 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T13:14:22.729 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T13:14:22.744 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:14:22.773 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T13:14:22.817 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T13:14:22.849 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T13:14:22.877 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T13:14:22.910 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:14:22.945 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T13:14:22.955 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:14:22.999 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T13:14:23.010 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:14:23.030 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T13:14:23.074 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T13:14:23.082 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:14:23.113 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:14:23.150 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T13:14:23.150 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:14:23.185 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T13:14:23.205 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:14:23.228 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T13:14:23.241 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:14:23.257 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T13:14:23.284 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:14:23.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T13:14:23.327 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:14:23.371 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T13:14:23.445 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T13:14:23.463 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:14:23.507 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:14:23.537 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:14:23.577 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T13:14:23.578 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:14:23.632 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T13:14:23.672 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:14:23.712 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:14:23.751 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:14:23.777 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:14:23.802 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:14:23.878 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:14:24.003 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:14:24.034 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:14:24.053 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:14:24.088 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:14:24.127 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:14:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:14:24.159 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T13:14:24.188 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:14:24.223 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:14:24.245 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T13:14:24.256 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:14:24.282 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T13:14:24.298 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:14:24.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T13:14:24.332 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:14:24.363 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T13:14:24.404 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T13:14:24.419 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:14:24.471 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:14:24.502 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:14:24.546 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T13:14:24.549 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:14:24.599 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T13:14:24.648 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:14:24.654 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T13:14:24.703 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:14:24.726 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T13:14:24.759 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T13:14:24.796 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T13:14:24.842 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T13:14:24.878 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T13:14:24.921 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T13:14:24.963 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T13:14:25.098 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T13:14:25.144 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T13:14:25.174 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T13:14:25.215 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T13:14:25.309 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T13:14:25.358 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T13:14:25.397 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T13:14:25.440 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T13:14:25.441 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:14:25.465 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T13:14:25.500 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:14:25.534 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:14:25.539 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T13:14:25.632 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:14:25.666 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T13:14:25.683 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:14:25.706 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T13:14:25.734 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T13:14:25.768 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T13:14:25.771 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:14:25.807 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T13:14:25.811 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:14:25.838 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T13:14:25.869 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T13:14:25.903 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T13:14:25.937 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T13:14:25.978 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T13:14:25.987 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:14:26.012 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T13:14:26.017 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:14:26.095 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:14:26.098 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T13:14:26.168 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T13:14:26.208 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T13:14:26.255 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T13:14:26.353 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T13:14:26.410 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T13:14:26.778 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:14:26.890 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:14:27.124 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T13:14:27.173 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T13:14:27.207 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T13:14:27.305 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T13:14:27.356 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T13:14:27.434 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T13:14:27.476 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T13:14:27.654 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T13:14:27.682 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T13:14:27.760 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T13:14:28.113 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:14:28.203 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:14:28.231 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:14:28.264 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:14:28.386 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T13:14:28.497 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T13:14:28.575 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:14:28.627 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:28.717 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:28.748 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T13:14:28.784 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:14:29.264 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:14:29.288 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:29.359 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:29.381 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T13:14:29.713 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T13:14:29.805 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T13:14:29.832 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T13:14:29.865 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T13:14:30.177 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T13:14:30.220 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:30.310 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T13:14:30.341 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T13:14:30.378 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T13:14:30.857 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T13:14:30.889 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:30.994 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T13:14:31.172 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T13:14:31.934 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:31.969 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:32.508 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:32.555 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:32.652 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:32.652 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:14:32.652 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:14:32.652 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:32.690 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:33.524 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:33.563 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:34.105 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T13:14:34.150 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:34.240 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T13:14:34.240 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T13:14:34.240 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T13:14:34.241 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:34.267 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:44.064 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:44.064 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-04-25T13:14:44.064 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-04-25T13:14:44.064 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-04-25T13:14:44.064 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-04-25T13:14:44.064 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-04-25T13:14:44.065 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-04-25T13:14:44.065 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-04-25T13:14:44.065 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:44.233 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:44.251 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:44.251 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:44.251 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:14:44.251 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:45.720 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:45.746 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:45.746 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:45.746 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:14:45.746 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:45.746 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:45.746 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:45.971 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:45.993 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:45.993 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:45.993 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:14:45.993 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:45.993 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:45.993 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-04-25T13:14:46.031 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-04-25T13:14:46.032 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-04-25T13:14:46.032 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:46.207 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T13:14:46.223 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.223 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T13:14:46.223 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:46.438 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:46.460 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:46.460 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:46.460 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:14:46.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:46.460 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:46.460 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:46.560 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:14:46.616 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:14:46.672 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:14:46.859 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:14:46.913 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:14:46.991 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:14:47.080 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:14:47.219 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:14:47.263 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:14:47.295 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:14:47.322 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:14:47.711 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:47.736 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T13:14:47.736 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:47.737 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T13:14:47.737 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:47.737 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T13:14:47.737 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:47.775 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:47.804 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:47.837 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T13:14:47.890 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T13:14:47.919 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:47.961 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:47.983 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T13:14:47.983 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:47.984 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T13:14:47.984 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:47.984 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T13:14:47.984 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:48.437 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:48.459 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T13:14:48.459 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:48.459 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T13:14:48.460 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:48.460 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T13:14:48.460 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:48.567 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T13:14:48.616 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T13:14:48.671 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T13:14:48.861 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T13:14:48.913 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T13:14:48.966 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:48.991 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T13:14:49.004 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:49.080 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:14:49.219 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:14:49.255 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T13:14:49.287 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T13:14:49.315 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T13:14:49.708 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:49.747 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T13:14:49.779 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T13:14:49.841 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T13:14:49.879 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:49.973 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:50.004 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:50.107 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:50.277 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T13:14:50.306 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:50.329 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:50.329 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:50.330 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:14:50.330 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:50.330 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:50.330 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:50.373 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:50.384 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:50.482 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T13:14:50.530 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T13:14:50.910 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T13:14:50.964 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:51.456 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:14:51.484 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:51.507 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:51.508 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.508 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:14:51.508 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:51.508 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:51.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:51.560 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:51.582 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:51.582 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.582 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:14:51.582 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:51.627 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:51.649 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:51.649 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.649 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:14:51.650 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:51.650 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:51.650 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:51.928 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T13:14:51.953 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:51.964 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:51.975 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:51.975 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:51.975 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:14:51.975 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:51.975 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:51.975 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:14:52.064 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T13:14:52.237 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T13:14:52.266 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:52.289 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T13:14:52.289 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:52.289 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T13:14:52.290 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:52.290 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T13:14:52.290 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:52.333 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:52.344 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T13:14:52.443 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T13:14:52.490 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T13:14:53.414 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T13:14:53.453 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:53.475 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T13:14:53.475 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:53.475 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T13:14:53.475 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:53.475 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:14:53.475 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:53.520 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T13:14:53.542 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:53.542 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T13:14:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:53.587 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T13:14:53.609 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:53.609 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T13:14:53.609 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:53.609 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:14:53.609 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:53.913 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:53.935 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T13:14:53.935 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T13:14:53.935 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T13:14:53.935 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:53.936 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T13:14:53.936 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:14:56.581 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T13:14:56.622 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T13:14:56.663 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T13:14:56.695 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:14:56.722 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:14:56.907 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T13:14:56.960 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:14:56.989 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T13:14:57.613 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:57.653 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:57.673 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:58.524 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T13:14:58.552 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T13:14:58.594 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T13:14:58.607 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:14:58.634 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T13:14:58.648 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:14:58.667 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T13:14:58.703 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T13:14:58.730 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:14:58.762 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:14:58.762 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:58.854 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:14:58.884 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T13:14:58.887 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:14:58.887 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:58.934 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T13:14:58.964 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T13:14:58.977 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:14:59.044 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:14:59.579 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:59.615 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:14:59.634 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T13:15:00.464 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T13:15:00.566 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T13:15:00.607 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T13:15:00.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T13:15:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T13:15:00.722 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:15:00.806 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T13:15:00.848 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:15:00.848 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:15:00.930 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T13:15:00.997 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:15:05.005 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T13:15:05.006 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T13:15:05.007 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T13:15:05.007 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T13:15:05.007 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T13:15:05.007 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T13:15:05.007 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T13:15:05.019 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:15:05.020 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:15:05.021 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:15:05.022 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:15:05.023 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:15:05.024 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:15:05.025 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:15:05.026 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:15:05.027 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:15:05.028 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-04-25T13:15:07.057 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.058 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.059 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:15:07.060 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:15:07.061 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:15:07.062 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:15:07.063 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:15:07.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:15:07.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:15:07.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:15:07.068 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:15:07.069 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:07.069 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-04-25T13:15:07.379 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:07.379 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T13:15:07.379 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T13:15:07.379 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T13:15:07.380 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T13:15:07.381 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T13:15:07.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T13:15:07.383 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T13:15:07.384 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T13:15:07.385 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T13:15:07.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T13:15:07.387 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T13:15:07.388 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T13:15:07.389 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T13:15:07.390 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T13:15:07.460 DEBUG:teuthology.parallel:result is None 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.432 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.433 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T13:15:09.434 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.435 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T13:15:09.436 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T13:15:09.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T13:15:09.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T13:15:09.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T13:15:09.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T13:15:09.442 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T13:15:09.443 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T13:15:09.443 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:09.443 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-25T13:15:09.843 DEBUG:teuthology.parallel:result is None 2024-04-25T13:15:09.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:15:10.059 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:15:10.082 INFO:teuthology.orchestra.run.smithi155.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:10.085 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:10.085 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T13:15:10.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T13:15:10.305 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T13:15:10.327 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:10.328 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T13:15:10.328 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T13:15:10.329 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T13:15:10.330 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:10.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:15:10.361 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:10.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:15:10.394 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T13:15:10.395 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:10.395 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:15:10.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:15:10.495 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:10.495 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:15:10.519 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:15:10.582 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T13:15:10.582 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:10.583 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:15:10.608 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:15:10.673 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:10.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:15:10.698 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:15:10.761 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T13:15:10.762 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:10.762 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:15:10.786 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:15:10.852 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:10.852 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:15:10.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:15:10.938 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T13:15:11.027 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T13:15:11.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-04-25T13:15:11.030 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2024-04-25T13:15:11.054 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T13:15:11.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:15:11.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:15:11.119 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T13:15:11.119 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:15:11.160 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:15:11.191 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T13:15:11.191 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T13:15:11.191 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T13:15:11.191 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:11.191 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:15:11.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:11.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:11.382 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:11.383 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:15:11.397 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:11.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:11.550 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T13:15:11.550 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T13:15:11.550 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7673467', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '4d7908725372ec8e17504b848bfa122dd1d43386'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4060, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '4d7908725372ec8e17504b848bfa122dd1d43386', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF/saQmDJyV2hS47JOvNhUK4ffFhbtlhuMj+u3WOLqaqROWnhhuVK4hKnZtmDissiHHtT1DgSRmETNEquqgBGlA=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIS6BIKUzRV+LkT9bLLyOgodTaBBUm/F+1prQJl0xUcFFLpHOJCtUyjVr+nQBmNkQaAQfnk8zmG0nLB+lnQRl7o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_12:17:05', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T13:15:11.551 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:15:11.553 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:15:11.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:15:11.608 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:15:11.662 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:11.662 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:15:11.684 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:15:11.684 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-04-25T13:15:11.738 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:15:11.738 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 13:14:59.404919341 +0000 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 13:12:50.497981969 +0000 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 13:12:50.497981969 +0000 2024-04-25T13:15:11.739 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 13:12:50.497981969 +0000 2024-04-25T13:15:11.739 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:15:11.800 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T13:15:11.800 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T13:15:11.800 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000263053 s, 1.9 MB/s 2024-04-25T13:15:11.801 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:15:11.857 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-04-25T13:15:11.911 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:15:11.911 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:11.911 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-25T13:15:11.911 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:11.911 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:11.911 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 13:14:59.405919320 +0000 2024-04-25T13:15:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 13:12:50.842974736 +0000 2024-04-25T13:15:11.912 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 13:12:50.842974736 +0000 2024-04-25T13:15:11.912 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 13:12:50.842974736 +0000 2024-04-25T13:15:11.912 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:15:11.973 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T13:15:11.973 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T13:15:11.973 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000178861 s, 2.9 MB/s 2024-04-25T13:15:11.974 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:15:12.030 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-04-25T13:15:12.085 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:15:12.085 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:12.085 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T13:15:12.085 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 13:14:59.405919320 +0000 2024-04-25T13:15:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 13:12:51.196967313 +0000 2024-04-25T13:15:12.086 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 13:12:51.196967313 +0000 2024-04-25T13:15:12.086 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 13:12:51.196967313 +0000 2024-04-25T13:15:12.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:15:12.147 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T13:15:12.147 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T13:15:12.148 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000164454 s, 3.1 MB/s 2024-04-25T13:15:12.149 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:15:12.204 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-04-25T13:15:12.259 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:15:12.259 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:12.259 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T13:15:12.259 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:12.259 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:12.259 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-04-25 13:14:59.405919320 +0000 2024-04-25T13:15:12.260 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-04-25 13:12:51.534960226 +0000 2024-04-25T13:15:12.260 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-04-25 13:12:51.534960226 +0000 2024-04-25T13:15:12.260 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-04-25 13:12:51.534960226 +0000 2024-04-25T13:15:12.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:15:12.321 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-04-25T13:15:12.321 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-04-25T13:15:12.322 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000164566 s, 3.1 MB/s 2024-04-25T13:15:12.323 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:15:12.378 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:12.378 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:12.378 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:15:12.394 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:15:12.395 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-04-25T13:15:12.451 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:15:12.451 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:12.452 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T13:15:12.452 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:12.452 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:12.452 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 13:15:01.394525300 +0000 2024-04-25T13:15:12.452 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 13:12:52.872410932 +0000 2024-04-25T13:15:12.452 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 13:12:52.872410932 +0000 2024-04-25T13:15:12.453 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 13:12:52.872410932 +0000 2024-04-25T13:15:12.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:15:12.515 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T13:15:12.515 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T13:15:12.515 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000277078 s, 1.8 MB/s 2024-04-25T13:15:12.516 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:15:12.572 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-04-25T13:15:12.629 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:15:12.629 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:12.629 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T13:15:12.629 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:12.630 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:12.630 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 13:15:01.394525300 +0000 2024-04-25T13:15:12.630 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 13:12:53.214404875 +0000 2024-04-25T13:15:12.630 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 13:12:53.214404875 +0000 2024-04-25T13:15:12.630 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 13:12:53.214404875 +0000 2024-04-25T13:15:12.630 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:15:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T13:15:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T13:15:12.692 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000235024 s, 2.2 MB/s 2024-04-25T13:15:12.693 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:15:12.750 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 13:15:01.394525300 +0000 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 13:12:53.557398800 +0000 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 13:12:53.557398800 +0000 2024-04-25T13:15:12.804 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 13:12:53.557398800 +0000 2024-04-25T13:15:12.805 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:15:12.865 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T13:15:12.865 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T13:15:12.865 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000209101 s, 2.4 MB/s 2024-04-25T13:15:12.866 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:15:12.922 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-04-25T13:15:12.976 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:15:12.976 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-25 13:15:01.394525300 +0000 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-25 13:12:53.890392903 +0000 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-25 13:12:53.890392903 +0000 2024-04-25T13:15:12.977 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-25 13:12:53.890392903 +0000 2024-04-25T13:15:12.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:15:13.039 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-25T13:15:13.039 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-25T13:15:13.039 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000184609 s, 2.8 MB/s 2024-04-25T13:15:13.040 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:15:13.097 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:13.097 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:15:13.097 INFO:tasks.ceph:Generating config... 2024-04-25T13:15:13.098 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T13:15:13.099 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T13:15:13.099 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T13:15:13.099 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T13:15:13.099 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T13:15:13.099 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T13:15:13.099 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T13:15:13.100 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T13:15:13.101 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T13:15:13.101 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T13:15:13.101 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T13:15:13.101 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:13.101 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T13:15:13.102 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T13:15:13.102 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T13:15:13.103 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:13.155 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T13:15:13.157 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T13:15:13.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:13.263 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.155'), ('mon.b', '172.21.15.191'), ('mon.c', '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]')] 2024-04-25T13:15:13.264 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.155,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T13:15:13.265 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:13.265 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:15:13.319 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.155 --add b 172.21.15.191 --addv c '[v2:172.21.15.191:3301,v1:172.21.15.191:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:13.403 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:13.403 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool: generated fsid 99137c81-994c-40b7-8b7f-aeb03a97ab57 2024-04-25T13:15:13.403 INFO:teuthology.orchestra.run.smithi155.stdout:setting min_mon_release = quincy 2024-04-25T13:15:13.403 INFO:teuthology.orchestra.run.smithi155.stdout:epoch 0 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:fsid 99137c81-994c-40b7-8b7f-aeb03a97ab57 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:last_changed 2024-04-25T13:15:13.404712+0000 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:created 2024-04-25T13:15:13.404712+0000 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:min_mon_release 17 (quincy) 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:election_strategy: 1 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:0: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.a 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:2: [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] mon.c 2024-04-25T13:15:13.404 INFO:teuthology.orchestra.run.smithi155.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T13:15:13.405 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:15:13.420 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 99137c81-994c-40b7-8b7f-aeb03a97ab57... 2024-04-25T13:15:13.420 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:15:13.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-04-25T13:15:13.499 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.500 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-04-25T13:15:13.501 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.155,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 99137c81-994c-40b7-8b7f-aeb03a97ab57 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-04-25T13:15:13.502 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:15:13.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T13:15:13.504 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: mon client directed command retry = 5 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject delay max = 1 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject delay type = client mds 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject socket failures = 2500 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: osd blocked scrub grace period = 3600 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: osd max markdown count = 1000 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-04-25T13:15:13.505 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T13:15:13.506 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:15:13.507 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:15:13.508 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout: client_shutdown_timeout = 120 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.e] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-25T13:15:13.509 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.f] 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal fragment size max = 10000 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal merge size = 5 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split bits = 3 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds bal split size = 100 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds oft prefetch dirfrags = True 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-04-25T13:15:13.510 INFO:teuthology.orchestra.run.smithi155.stdout: mds_dir_prefetch = True 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: mon client directed command retry = 5 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject delay max = 1 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject delay type = client mds osd 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: ms inject socket failures = 2500 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-04-25T13:15:13.511 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:15:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.155,172.21.15.191,[v2:172.21.15.191:3301,v1:172.21.15.191:6790]" 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 99137c81-994c-40b7-8b7f-aeb03a97ab57 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2024-04-25T13:15:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug trim objects = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2024-04-25T13:15:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 20 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 20 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 10 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: mon client directed command retry = 5 2024-04-25T13:15:13.517 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject delay max = 1 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject delay type = client mds 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject socket failures = 2500 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: osd blocked scrub grace period = 3600 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: osd max markdown count = 1000 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.518 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-25T13:15:13.519 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.520 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: mon down mkfs grace = 300 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: mon op complaint time = 120 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: client mount timeout = 600 2024-04-25T13:15:13.521 INFO:teuthology.orchestra.run.smithi191.stdout: client_shutdown_timeout = 120 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout: debug client = 20 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.e] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.f] 2024-04-25T13:15:13.522 INFO:teuthology.orchestra.run.smithi191.stdout:[mds] 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds = 20 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: debug mds balancer = 20 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds bal fragment size max = 10000 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds bal merge size = 5 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds bal split bits = 3 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds bal split size = 100 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug frag = True 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds debug scatterstat = True 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds oft prefetch dirfrags = True 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds op complaint time = 180 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds verify scatter = True 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds_dir_prefetch = True 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T13:15:13.523 INFO:teuthology.orchestra.run.smithi191.stdout: mon client directed command retry = 5 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject delay max = 1 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject delay probability = 0.005 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject delay type = client mds osd 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject socket failures = 2500 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: osd op complaint time = 180 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: rados mon op timeout = 900 2024-04-25T13:15:13.524 INFO:teuthology.orchestra.run.smithi191.stdout: rados osd op timeout = 900 2024-04-25T13:15:13.525 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T13:15:13.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T13:15:13.617 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T13:15:13.617 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:13.617 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T13:15:13.631 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:13.631 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T13:15:13.686 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:15:13.686 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:13.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:15:13.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:13.758 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:13.758 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:13.812 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:15:13.812 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:13.812 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:15:13.812 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:15:13.846 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:13.846 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:13.900 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T13:15:13.900 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T13:15:13.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:15:13.948 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:15:13.951 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:15:14.004 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:15:14.006 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T13:15:14.006 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:15:14.059 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:15:14.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T13:15:14.084 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:15:14.173 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:15:14.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T13:15:14.198 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T13:15:14.289 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T13:15:14.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T13:15:14.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:15:14.364 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:15:14.367 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T13:15:14.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:15:14.478 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:15:14.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T13:15:14.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T13:15:14.592 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T13:15:14.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T13:15:14.617 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T13:15:14.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T13:15:14.657 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T13:15:14.669 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T13:15:14.669 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:15:14.669 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:14.733 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:14.733 INFO:tasks.ceph:role: osd.0 2024-04-25T13:15:14.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:15:14.733 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:15:14.804 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:14.805 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:15.298 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T13:15:15.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T13:15:15.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:15.415 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:15.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:15.510 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:15.510 INFO:tasks.ceph:role: osd.1 2024-04-25T13:15:15.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:15:15.510 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:15:15.581 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:15.581 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:15.581 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:15.581 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:15.582 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:15.582 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:15.582 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:15.582 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:15.582 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:15.582 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:16.037 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T13:15:16.039 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T13:15:16.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:16.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:16.185 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:16.250 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:16.250 INFO:tasks.ceph:role: osd.2 2024-04-25T13:15:16.250 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:15:16.250 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:15:16.322 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:16.322 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:16.323 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:16.818 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T13:15:16.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T13:15:16.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:16.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:16.952 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:17.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:17.018 INFO:tasks.ceph:role: osd.3 2024-04-25T13:15:17.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:15:17.018 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:15:17.092 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:17.092 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:17.092 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:17.092 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:17.092 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:17.093 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:17.093 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:17.093 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:17.093 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:17.093 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:17.617 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-04-25T13:15:17.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-04-25T13:15:17.619 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:17.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:17.786 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:17.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:17.880+0000 7f98e7e86640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T13:15:17.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:17.885+0000 7f98e7e86640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T13:15:17.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:17.885+0000 7f98e7e86640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:17.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:17.885+0000 7f98e7e86640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:17.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:17.885+0000 7f98e7e86640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:15:17.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:17.887+0000 7f98e7e86640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T13:15:20.738 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T13:15:20.766 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:20.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:20.854+0000 7fc60981a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T13:15:20.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:20.855+0000 7fc60981a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T13:15:20.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:20.855+0000 7fc60981a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:20.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:20.855+0000 7fc60981a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:20.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:20.855+0000 7fc60981a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:15:20.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:20.855+0000 7fc60981a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T13:15:23.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T13:15:23.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:23.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:23.817+0000 7fb7cd3c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T13:15:23.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:23.818+0000 7fb7cd3c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T13:15:23.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:23.818+0000 7fb7cd3c2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:23.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:23.818+0000 7fb7cd3c2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:23.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:23.818+0000 7fb7cd3c2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:15:23.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:23.818+0000 7fb7cd3c2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T13:15:26.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T13:15:26.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:26.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:26.776+0000 7f51ca7c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T13:15:26.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:26.777+0000 7f51ca7c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T13:15:26.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:26.777+0000 7f51ca7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:26.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:26.777+0000 7f51ca7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:26.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:26.777+0000 7f51ca7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:15:26.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:26.777+0000 7f51ca7c2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T13:15:29.631 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T13:15:29.659 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:29.687 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:29.687 INFO:tasks.ceph:role: osd.4 2024-04-25T13:15:29.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:15:29.688 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:29.762 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:30.259 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-25T13:15:30.261 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-25T13:15:30.262 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:30.376 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:30.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:30.470 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:30.470 INFO:tasks.ceph:role: osd.5 2024-04-25T13:15:30.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:15:30.470 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:15:30.541 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:30.542 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:31.007 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-25T13:15:31.009 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-25T13:15:31.009 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:31.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:31.127 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:31.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:31.190 INFO:tasks.ceph:role: osd.6 2024-04-25T13:15:31.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:15:31.190 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:31.260 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:31.755 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-25T13:15:31.757 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-25T13:15:31.757 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:31.886 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:31.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:31.976 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:15:31.976 INFO:tasks.ceph:role: osd.7 2024-04-25T13:15:31.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:15:31.976 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:15:32.048 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:15:32.049 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:15:32.049 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:15:32.049 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T13:15:32.049 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:15:32.049 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:15:32.049 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:15:32.050 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T13:15:32.050 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:15:32.050 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:15:32.573 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-25T13:15:32.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-25T13:15:32.575 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:32.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:32.739 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:32.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:32.827+0000 7f8bc9f3b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T13:15:32.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:32.827+0000 7f8bc9f3b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T13:15:32.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:32.827+0000 7f8bc9f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:32.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:32.827+0000 7f8bc9f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:32.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:32.827+0000 7f8bc9f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:15:32.829 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:32.829+0000 7f8bc9f3b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T13:15:35.677 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T13:15:35.705 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:35.793 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:35.793+0000 7f3d2f016640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T13:15:35.793 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:35.793+0000 7f3d2f016640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T13:15:35.793 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:35.793+0000 7f3d2f016640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:35.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:35.793+0000 7f3d2f016640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:35.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:35.793+0000 7f3d2f016640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:15:35.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:35.794+0000 7f3d2f016640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T13:15:38.637 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T13:15:38.665 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:38.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:38.755+0000 7f3978812640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T13:15:38.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:38.756+0000 7f3978812640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T13:15:38.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:38.756+0000 7f3978812640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:38.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:38.756+0000 7f3978812640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:38.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:38.756+0000 7f3978812640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:15:38.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:38.756+0000 7f3978812640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T13:15:41.552 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:41.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:15:41.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T13:15:41.674 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:41.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:41.757+0000 7f9a50615640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T13:15:41.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:41.757+0000 7f9a50615640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T13:15:41.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:41.757+0000 7f9a50615640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:41.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:41.757+0000 7f9a50615640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:41.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:41.758+0000 7f9a50615640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:15:41.758 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:41.758+0000 7f9a50615640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T13:15:44.608 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T13:15:44.677 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T13:15:44.677 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:44.677 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T13:15:44.706 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:44.706 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T13:15:44.774 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:44.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T13:15:44.840 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:44.840 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T13:15:44.906 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:44.906 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T13:15:44.970 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:44.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T13:15:45.035 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:45.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T13:15:45.098 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:45.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T13:15:45.162 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.162 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T13:15:45.191 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T13:15:45.257 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.258 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T13:15:45.323 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T13:15:45.389 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.389 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T13:15:45.453 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.453 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T13:15:45.519 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.519 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T13:15:45.583 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:45.583 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T13:15:45.648 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:45.648 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T13:15:45.663 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T13:15:45.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:15:45.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBhVypmxT6cOBAAtCobqzr+7rS9hE5MhjUcbg== 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypmrweZAxAARaeCqFJQgnifhuqxQqOWEA== 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypm6HJmChAAN6Kc9QsxgPHw73/tllZ8qg== 2024-04-25T13:15:45.725 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.e] 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypm8bRLERAA4I/L29V39L7/l00jsG9KzQ== 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBlVypmI0GINBAARn7YOcY/188YAnOWA0oXKw== 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBoVypmm5r9MhAAUzes2an/VtTKC7aq3gmLcA== 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBrVypmTYbLMBAAQ22OhZYWvuhughfRlcyE4A== 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBuVypm8RJYLhAALbjN8nEDdmMWQCctv+XInw== 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypmiEpLABAALwSzG6mhFSDdKIu3vAQptA== 2024-04-25T13:15:45.726 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypm9DzNFRAAhWmfqVdO4yznZldRftgxRg== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypmfduZHBAA8oAvcHp3rgHzcoghVwH0Vw== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.f] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypmaPxiIxAALxXwRdF0pK/LhoneSJPOmQ== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB0VypmsjZwMRAA7/earwUfa1nib0Tj6tzZoQ== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB3Vypm1JJYLxAAJK+rB4dbg+YRAMbtWWabMQ== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB6VypmKFAdLRAAmOPNuSp65f70T1zDZnMdvg== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQB9VypmGYk4LRAApzv2yL5SzSqx5JTGdd+X9g== 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-04-25T13:15:45.727 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBiVypm/S1DJxAAD7DiZ7Hy1fL3xZBHSbWopw== 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBhVypmxT6cOBAAtCobqzr+7rS9hE5MhjUcbg== 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.a] 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypmrweZAxAARaeCqFJQgnifhuqxQqOWEA== 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.c] 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypm6HJmChAAN6Kc9QsxgPHw73/tllZ8qg== 2024-04-25T13:15:45.728 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.e] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypm8bRLERAA4I/L29V39L7/l00jsG9KzQ== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBlVypmI0GINBAARn7YOcY/188YAnOWA0oXKw== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBoVypmm5r9MhAAUzes2an/VtTKC7aq3gmLcA== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBrVypmTYbLMBAAQ22OhZYWvuhughfRlcyE4A== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBuVypm8RJYLhAALbjN8nEDdmMWQCctv+XInw== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypmiEpLABAALwSzG6mhFSDdKIu3vAQptA== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.b] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypm9DzNFRAAhWmfqVdO4yznZldRftgxRg== 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.d] 2024-04-25T13:15:45.729 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypmfduZHBAA8oAvcHp3rgHzcoghVwH0Vw== 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout:[mds.f] 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypmaPxiIxAALxXwRdF0pK/LhoneSJPOmQ== 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB0VypmsjZwMRAA7/earwUfa1nib0Tj6tzZoQ== 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB3Vypm1JJYLxAAJK+rB4dbg+YRAMbtWWabMQ== 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB6VypmKFAdLRAAmOPNuSp65f70T1zDZnMdvg== 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB9VypmGYk4LRAApzv2yL5SzSqx5JTGdd+X9g== 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2024-04-25T13:15:45.730 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBiVypm/S1DJxAAD7DiZ7Hy1fL3xZBHSbWopw== 2024-04-25T13:15:45.732 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:45.774 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:45.823 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:45.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:45.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:45.879 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:45.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:45.932 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:45.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:45.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.036 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.087 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.136 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.138 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.187 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:46.190 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:15:46.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:46.240 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:46.292 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:46.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:46.350 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:46.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:15:46.403 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.457 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.508 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.556 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.559 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:15:46.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:15:46.610 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:15:46.661 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T13:15:46.662 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T13:15:46.685 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:46.779 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T13:15:46.802 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T13:15:46.826 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:46.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T13:15:46.943 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T13:15:47.006 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:15:47.100 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T13:15:47.123 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:47.126 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:15:47.178 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T13:15:47.178 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T13:15:47.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T13:15:47.181 INFO:tasks.ceph.mon.a:Started 2024-04-25T13:15:47.181 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T13:15:47.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T13:15:47.221 INFO:tasks.ceph.mon.b:Started 2024-04-25T13:15:47.221 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T13:15:47.222 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T13:15:47.223 INFO:tasks.ceph.mon.c:Started 2024-04-25T13:15:47.224 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T13:15:47.224 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T13:15:47.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T13:15:47.226 INFO:tasks.ceph.mgr.y:Started 2024-04-25T13:15:47.226 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T13:15:47.226 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T13:15:47.228 INFO:tasks.ceph.mgr.x:Started 2024-04-25T13:15:47.228 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T13:15:47.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T13:15:47.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.326+0000 7f5ae809e640 1 Processor -- start 2024-04-25T13:15:47.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.326+0000 7f5ae809e640 1 -- start start 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae809e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae809e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae809e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae809e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae006fd10 con 0x7f5ae00c6410 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae809e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae00cadb0 con 0x7f5ae006f810 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae809e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae00cb090 con 0x7f5ae00c6030 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae5639640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae5639640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:60368/0 (socket says 172.21.15.155:60368) 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 learned_addr learned my addr 172.21.15.155:0/1687370205 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.327+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:47.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:47.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.328+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:47.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:47.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.529+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:47.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:47.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:47.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:47.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:47.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:47.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:47.930+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:48.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:48.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:48.731+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5ae00c89c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5ae00c89c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 msgr2=0x7f5ae015c4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5ae006f810 0x7f5ae015c4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 msgr2=0x7f5ae006f2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5ae00c6410 0x7f5ae006f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ae00cb370 con 0x7f5acc0073d0 2024-04-25T13:15:50.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:50.328+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc00c100 con 0x7f5acc003690 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> v1:172.21.15.191:6789/0 conn(0x7f5acc003690 legacy=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> v1:172.21.15.155:6789/0 conn(0x7f5acc0073d0 legacy=0x7f5acc009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 reap_dead start 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc00d3a0 con 0x7f5acc00c460 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae006fd10 con 0x7f5acc006240 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae00cadb0 con 0x7f5ae00c6030 2024-04-25T13:15:53.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:53.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.329+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.530+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:53.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:53.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:53.931+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:54.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae5639640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.732+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:54.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:54.733+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 msgr2=0x7f5acc0116f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ae00c6030 0x7f5acc0116f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 msgr2=0x7f5acc005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.191:3300/0 conn(0x7f5acc006240 0x7f5acc005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 >> v1:172.21.15.155:6789/0 conn(0x7f5acc00c460 legacy=0x7f5acc00c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc00d080 con 0x7f5acc009850 2024-04-25T13:15:56.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ad77fe640 1 -- 172.21.15.155:0/1687370205 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5ae006fd10 con 0x7f5acc006760 2024-04-25T13:15:56.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:56.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:56.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:56.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:56.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.329+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:15:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.530+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.530+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.530+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.530+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.530+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T13:15:56.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.931+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:56.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.931+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:15:56.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.931+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:15:56.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.931+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:15:56.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:56.931+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T13:15:57.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.492+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253186863 0 0) 0x7f5acc00d080 con 0x7f5acc009850 2024-04-25T13:15:57.494 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.492+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac4003520 con 0x7f5acc009850 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1706096112 0 0) 0x7f5ac4003520 con 0x7f5acc009850 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 msgr2=0x7f5acc006b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 --2- 172.21.15.155:0/1687370205 >> v2:172.21.15.155:3300/0 conn(0x7f5acc006760 0x7f5acc006b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 --> v1:172.21.15.191:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc00a690 con 0x7f5acc009850 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 <== mon.1 v1:172.21.15.191:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f5ad000f040 con 0x7f5acc009850 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 >> v1:172.21.15.191:6789/0 conn(0x7f5acc009850 legacy=0x7f5acc009f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae663b640 1 -- 172.21.15.155:0/1687370205 reap_dead start 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac40039b0 0x7f5ac4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac4004800 0x7f5ac4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ac400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:57.495 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae006fd10 con 0x7f5ac40039b0 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac400c1e0 con 0x7f5ac4004800 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac400c3e0 con 0x7f5ac4005290 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac40039b0 0x7f5ac4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac4004800 0x7f5ac4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.493+0000 7f5ae663b640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ac400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.494+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 msgr2=0x7f5ac400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.494+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ac400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.494+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac4004800 msgr2=0x7f5ac4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.494+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac4004800 0x7f5ac4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.494+0000 7f5ae5e3a640 1 -- 172.21.15.155:0/1687370205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac4003520 con 0x7f5ac40039b0 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.494+0000 7f5ae5639640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac4004800 0x7f5ac4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:57.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.495+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac40039b0 0x7f5ac4003db0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5adc018440 tx=0x7f5ac4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dd9359d6760835 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.495+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc032070 con 0x7f5ac40039b0 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc02cd30 con 0x7f5ac40039b0 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae4e38640 1 -- 172.21.15.155:0/1687370205 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc009c40 con 0x7f5ac40039b0 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 -- 172.21.15.155:0/1687370205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac40039b0 msgr2=0x7f5ac4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac40039b0 0x7f5ac4003db0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5adc018440 tx=0x7f5ac4005830 comp rx=0 tx=0).stop 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 -- 172.21.15.155:0/1687370205 shutdown_connections 2024-04-25T13:15:57.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ac400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac4004800 0x7f5ac4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 --2- 172.21.15.155:0/1687370205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac40039b0 0x7f5ac4003db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.496+0000 7f5ae809e640 1 -- 172.21.15.155:0/1687370205 >> 172.21.15.155:0/1687370205 conn(0x7f5ae0074d50 msgr2=0x7f5ae0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.497+0000 7f5ae809e640 1 -- 172.21.15.155:0/1687370205 shutdown_connections 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.497+0000 7f5ae809e640 1 -- 172.21.15.155:0/1687370205 wait complete. 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.498+0000 7f5ae809e640 1 Processor -- start 2024-04-25T13:15:57.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.498+0000 7f5ae809e640 1 -- start start 2024-04-25T13:15:57.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.499+0000 7f5ae809e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac40039b0 0x7f5ae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.499+0000 7f5ae809e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 0x7f5ae0143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.499+0000 7f5ae809e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ae01f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.499+0000 7f5ae809e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae006f2d0 con 0x7f5ac4004800 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.499+0000 7f5ae5639640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 0x7f5ae0143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.499+0000 7f5ae809e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae00cb930 con 0x7f5ac40039b0 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae809e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae006f450 con 0x7f5ac4005290 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 0x7f5ae0143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41658/0 (socket says 172.21.15.155:41658) 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 -- 172.21.15.155:0/310329220 learned_addr learned my addr 172.21.15.155:0/310329220 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5e3a640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac40039b0 0x7f5ae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae663b640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ae01f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:57.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 -- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 msgr2=0x7f5ae01f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:57.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ae01f0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 -- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac40039b0 msgr2=0x7f5ae006d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:57.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac40039b0 0x7f5ae006d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 -- 172.21.15.155:0/310329220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae01ec8e0 con 0x7f5ac4004800 2024-04-25T13:15:57.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae663b640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ae01f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:57.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.500+0000 7f5ae5639640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 0x7f5ae0143730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0019a50 tx=0x7f5ad0019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:57.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.501+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0028070 con 0x7f5ac4004800 2024-04-25T13:15:57.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.501+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad0004240 con 0x7f5ac4004800 2024-04-25T13:15:57.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.502+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae01ecb50 con 0x7f5ac4004800 2024-04-25T13:15:57.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.502+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0015860 con 0x7f5ac4004800 2024-04-25T13:15:57.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.502+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae01ed110 con 0x7f5ac4004800 2024-04-25T13:15:57.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.502+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ad002b070 con 0x7f5ac4004800 2024-04-25T13:15:57.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.502+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ad00237c0 con 0x7f5ac4004800 2024-04-25T13:15:57.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.503+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae0068f50 con 0x7f5ac4004800 2024-04-25T13:15:57.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.505+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5ad0003610 con 0x7f5ac4004800 2024-04-25T13:15:57.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.572+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5ae01efd40 con 0x7f5ac4004800 2024-04-25T13:15:57.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.574+0000 7f5ad67fc640 1 -- 172.21.15.155:0/310329220 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5ad00037f0 con 0x7f5ac4004800 2024-04-25T13:15:57.574 INFO:teuthology.orchestra.run.smithi155.stderr:adjusted tunables profile to default 2024-04-25T13:15:57.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 msgr2=0x7f5ae0143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 0x7f5ae0143730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0019a50 tx=0x7f5ad0019f10 comp rx=0 tx=0).stop 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 shutdown_connections 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ac4005290 0x7f5ae01f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ac4004800 0x7f5ae0143730 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 --2- 172.21.15.155:0/310329220 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ac40039b0 0x7f5ae006d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 >> 172.21.15.155:0/310329220 conn(0x7f5ae0074d50 msgr2=0x7f5ae0142790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 shutdown_connections 2024-04-25T13:15:57.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:57.575+0000 7f5ae809e640 1 -- 172.21.15.155:0/310329220 wait complete. 2024-04-25T13:15:57.588 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T13:15:57.588 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T13:15:57.588 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:57.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T13:15:57.607 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:57.607+0000 7f9653921040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:15:57.613 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:57.613 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T13:15:57.614 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:57.614+0000 7fa76c579040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:15:57.636 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:57.636 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T13:15:57.700 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:15:57.700 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T13:15:57.755 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:57.755+0000 7f9653921040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:57.767 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:57.767 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T13:15:57.790 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:57.790 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T13:15:57.799 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:57.799+0000 7fa76c579040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:57.809 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:57.810+0000 7f9653921040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:15:57.832 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:57.832 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T13:15:57.852 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:57.852+0000 7fa76c579040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:15:57.895 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-25T13:15:57.895 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T13:15:57.960 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 6a864f78-48bb-4c21-8263-ab0df95ced2c 0 2024-04-25T13:15:58.058 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:58.058+0000 7f9653921040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:15:58.094 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:58.094+0000 7fa76c579040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:15:58.098 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.098+0000 7f7158fcd640 1 Processor -- start 2024-04-25T13:15:58.098 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.098+0000 7f7158fcd640 1 -- start start 2024-04-25T13:15:58.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7158fcd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f71540c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7158fcd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f715406da60 0x7f7154161d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7158fcd640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71540c8110 con 0x7f715415b3e0 2024-04-25T13:15:58.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7158fcd640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f715406d5d0 con 0x7f715406da60 2024-04-25T13:15:58.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7158fcd640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f71540ca1c0 con 0x7f71540c94b0 2024-04-25T13:15:58.099 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7152d9d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f715406da60 0x7f7154161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f715259c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f71540c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7151d9b640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f715415b3e0 0x7f715406e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:33460/0 (socket says 172.21.15.191:33460) 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7151d9b640 1 -- 172.21.15.191:0/70789936 learned_addr learned my addr 172.21.15.191:0/70789936 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f715259c640 1 -- 172.21.15.191:0/70789936 >> v2:172.21.15.191:3300/0 conn(0x7f715406da60 msgr2=0x7f7154161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f715259c640 1 --2- 172.21.15.191:0/70789936 >> v2:172.21.15.191:3300/0 conn(0x7f715406da60 0x7f7154161d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f715259c640 1 -- 172.21.15.191:0/70789936 >> v1:172.21.15.191:6789/0 conn(0x7f715415b3e0 legacy=0x7f715406e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f715259c640 1 -- 172.21.15.191:0/70789936 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71540c83d0 con 0x7f71540c94b0 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f715159a640 1 -- 172.21.15.191:0/70789936 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228953070 0 0) 0x7f71540c8110 con 0x7f715415b3e0 2024-04-25T13:15:58.100 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.099+0000 7f7152d9d640 1 --2- 172.21.15.191:0/70789936 >> v2:172.21.15.191:3300/0 conn(0x7f715406da60 0x7f7154161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.100+0000 7f715259c640 1 --2- 172.21.15.191:0/70789936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f71540c9890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71440097a0 tx=0x7f714402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3b255bcb3848e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.100+0000 7f715159a640 1 -- 172.21.15.191:0/70789936 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144037070 con 0x7f71540c94b0 2024-04-25T13:15:58.101 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.100+0000 7f715159a640 1 -- 172.21.15.191:0/70789936 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7144032440 con 0x7f71540c94b0 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.100+0000 7f715159a640 1 -- 172.21.15.191:0/70789936 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144032810 con 0x7f71540c94b0 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 -- 172.21.15.191:0/70789936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 msgr2=0x7f71540c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 --2- 172.21.15.191:0/70789936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f71540c9890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71440097a0 tx=0x7f714402a180 comp rx=0 tx=0).stop 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 -- 172.21.15.191:0/70789936 shutdown_connections 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 --2- 172.21.15.191:0/70789936 >> v2:172.21.15.191:3300/0 conn(0x7f715406da60 0x7f7154161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 --2- 172.21.15.191:0/70789936 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f71540c9890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 -- 172.21.15.191:0/70789936 >> 172.21.15.191:0/70789936 conn(0x7f715406f4f0 msgr2=0x7f715406f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 -- 172.21.15.191:0/70789936 shutdown_connections 2024-04-25T13:15:58.102 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.101+0000 7f7158fcd640 1 -- 172.21.15.191:0/70789936 wait complete. 2024-04-25T13:15:58.105 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.102+0000 7f7158fcd640 1 Processor -- start 2024-04-25T13:15:58.105 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.102+0000 7f7158fcd640 1 -- start start 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f715406da60 0x7f71540afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f7154164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715415b3e0 0x7f7154164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f715415b800 con 0x7f715415b3e0 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f715406d260 con 0x7f715406da60 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f71540c2000 con 0x7f71540c94b0 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f7154164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f715259c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f715406da60 0x7f71540afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f7154164570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:59222/0 (socket says 172.21.15.191:59222) 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 -- 172.21.15.191:0/3530120509 learned_addr learned my addr 172.21.15.191:0/3530120509 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7152d9d640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715415b3e0 0x7f7154164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.106 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 -- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f715406da60 msgr2=0x7f71540afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f715406da60 0x7f71540afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 -- 172.21.15.191:0/3530120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715415b3e0 msgr2=0x7f7154164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715415b3e0 0x7f7154164ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 -- 172.21.15.191:0/3530120509 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71540b11b0 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f715259c640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f715406da60 0x7f71540afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7151d9b640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f7154164570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f714800c460 tx=0x7f714800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148018070 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7148007500 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148004a20 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.103+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715414fdb0 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.104+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f715414d970 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.104+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f714801b070 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.104+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7148012740 con 0x7f71540c94b0 2024-04-25T13:15:58.107 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.105+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154069520 con 0x7f71540c94b0 2024-04-25T13:15:58.108 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:58.106+0000 7f9653921040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:15:58.108 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.107+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7154069520 con 0x7f71540c94b0 2024-04-25T13:15:58.139 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:58.139+0000 7fa76c579040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:15:58.179 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.179+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6a864f78-48bb-4c21-8263-ab0df95ced2c", "id": 0} v 0) -- 0x7f7154068f50 con 0x7f71540c94b0 2024-04-25T13:15:58.182 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.182+0000 7f7142ffd640 1 -- 172.21.15.191:0/3530120509 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a864f78-48bb-4c21-8263-ab0df95ced2c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f7148004bc0 con 0x7f71540c94b0 2024-04-25T13:15:58.183 INFO:teuthology.orchestra.run.smithi191.stdout:0 2024-04-25T13:15:58.184 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 msgr2=0x7f7154164570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.184 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f7154164570 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f714800c460 tx=0x7f714800c920 comp rx=0 tx=0).stop 2024-04-25T13:15:58.184 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 shutdown_connections 2024-04-25T13:15:58.184 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f715415b3e0 0x7f7154164ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.184 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f71540c94b0 0x7f7154164570 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 --2- 172.21.15.191:0/3530120509 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f715406da60 0x7f71540afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 >> 172.21.15.191:0/3530120509 conn(0x7f715406f4f0 msgr2=0x7f71540cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 shutdown_connections 2024-04-25T13:15:58.185 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.183+0000 7f7158fcd640 1 -- 172.21.15.191:0/3530120509 wait complete. 2024-04-25T13:15:58.194 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790 1 2024-04-25T13:15:58.291 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.291+0000 7fbb23ca0640 1 Processor -- start 2024-04-25T13:15:58.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.291+0000 7fbb23ca0640 1 -- start start 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb23ca0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbb1c0c6410 0x7fbb1c0c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb23ca0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbb1c15c4a0 0x7fbb1c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb23ca0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb1c06fd10 con 0x7fbb1c0c6030 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb23ca0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c0cadb0 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb23ca0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbb1c0cb090 con 0x7fbb1c0c6410 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb2123b640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbb1c0c6410 0x7fbb1c0c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb2123b640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbb1c0c6410 0x7fbb1c0c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49640/0 (socket says 172.21.15.191:49640) 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.292+0000 7fbb2123b640 1 -- 172.21.15.191:0/3116180545 learned_addr learned my addr 172.21.15.191:0/3116180545 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2223d640 1 --2- 172.21.15.191:0/3116180545 >> v2:172.21.15.155:3300/0 conn(0x7fbb1c15c4a0 0x7fbb1c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2123b640 1 -- 172.21.15.191:0/3116180545 >> v2:172.21.15.155:3300/0 conn(0x7fbb1c15c4a0 msgr2=0x7fbb1c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:58.293 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2123b640 1 --2- 172.21.15.191:0/3116180545 >> v2:172.21.15.155:3300/0 conn(0x7fbb1c15c4a0 0x7fbb1c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2123b640 1 -- 172.21.15.191:0/3116180545 >> v1:172.21.15.155:6789/0 conn(0x7fbb1c0c6030 legacy=0x7fbb1c06f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2123b640 1 -- 172.21.15.191:0/3116180545 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c0cb370 con 0x7fbb1c0c6410 2024-04-25T13:15:58.294 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2223d640 1 --2- 172.21.15.191:0/3116180545 >> v2:172.21.15.155:3300/0 conn(0x7fbb1c15c4a0 0x7fbb1c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:58.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb2123b640 1 --2- 172.21.15.191:0/3116180545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c0c6410 0x7fbb1c0c89c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0cc770 tx=0x7fbb1802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f67232042c9e91bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.293+0000 7fbb20a3a640 1 -- 172.21.15.191:0/3116180545 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18037070 con 0x7fbb1c0c6410 2024-04-25T13:15:58.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb20a3a640 1 -- 172.21.15.191:0/3116180545 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1802ae50 con 0x7fbb1c0c6410 2024-04-25T13:15:58.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb20a3a640 1 -- 172.21.15.191:0/3116180545 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18032860 con 0x7fbb1c0c6410 2024-04-25T13:15:58.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3116180545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c0c6410 msgr2=0x7fbb1c0c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3116180545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c0c6410 0x7fbb1c0c89c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0cc770 tx=0x7fbb1802a300 comp rx=0 tx=0).stop 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3116180545 shutdown_connections 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3116180545 >> v2:172.21.15.155:3300/0 conn(0x7fbb1c15c4a0 0x7fbb1c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3116180545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c0c6410 0x7fbb1c0c89c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3116180545 >> 172.21.15.191:0/3116180545 conn(0x7fbb1c074d50 msgr2=0x7fbb1c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3116180545 shutdown_connections 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.294+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3116180545 wait complete. 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.295+0000 7fbb23ca0640 1 Processor -- start 2024-04-25T13:15:58.296 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.295+0000 7fbb23ca0640 1 -- start start 2024-04-25T13:15:58.298 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb23ca0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb1c0c6030 0x7fbb1c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.298 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb23ca0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb1c0c6410 0x7fbb1c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.298 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb23ca0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 0x7fbb1c06c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.298 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb23ca0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c15cdf0 con 0x7fbb1c0c6030 2024-04-25T13:15:58.298 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb23ca0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c0cb930 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb23ca0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbb1c06f9e0 con 0x7fbb1c0c6410 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 0x7fbb1c06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2123b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb1c0c6410 0x7fbb1c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 0x7fbb1c06c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49642/0 (socket says 172.21.15.191:49642) 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 -- 172.21.15.191:0/3078164384 learned_addr learned my addr 172.21.15.191:0/3078164384 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb21a3c640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb1c0c6030 0x7fbb1c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 -- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb1c0c6410 msgr2=0x7fbb1c1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb1c0c6410 0x7fbb1c1573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 -- 172.21.15.191:0/3078164384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb1c0c6030 msgr2=0x7fbb1c159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb1c0c6030 0x7fbb1c159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2223d640 1 -- 172.21.15.191:0/3078164384 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c159640 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.296+0000 7fbb2123b640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb1c0c6410 0x7fbb1c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb2223d640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 0x7fbb1c06c850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbb14007df0 tx=0x7fbb1400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1401a070 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.299 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb14003990 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c15b6e0 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb14003d80 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c06bd70 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb1401d070 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.297+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fbb1401fb60 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.298+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c06c360 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.300 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.300+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbb14024020 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.372 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.372+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790", "id": 1} v 0) -- 0x7fbb1c068f50 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.375 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.375+0000 7fbb127fc640 1 -- 172.21.15.191:0/3078164384 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fbb14010070 con 0x7fbb1c15c4a0 2024-04-25T13:15:58.377 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 msgr2=0x7fbb1c06c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 0x7fbb1c06c850 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbb14007df0 tx=0x7fbb1400d4a0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 shutdown_connections 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbb1c15c4a0 0x7fbb1c06c850 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbb1c0c6410 0x7fbb1c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 --2- 172.21.15.191:0/3078164384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb1c0c6030 0x7fbb1c159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 >> 172.21.15.191:0/3078164384 conn(0x7fbb1c074d50 msgr2=0x7fbb1c1e4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 shutdown_connections 2024-04-25T13:15:58.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.376+0000 7fbb23ca0640 1 -- 172.21.15.191:0/3078164384 wait complete. 2024-04-25T13:15:58.386 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 493b0471-6e11-4379-b815-b7693e3fe47e 2 2024-04-25T13:15:58.484 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.484+0000 7fb8892cf640 1 Processor -- start 2024-04-25T13:15:58.484 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.484+0000 7fb8892cf640 1 -- start start 2024-04-25T13:15:58.485 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8892cf640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb88415b070 0x7fb8840cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8892cf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8840c5c80 con 0x7fb8840cbae0 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8892cf640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88415b5d0 con 0x7fb8841553c0 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8892cf640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fb88415e660 con 0x7fb88415b070 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8827fc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb88415b070 0x7fb8840cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb882ffd640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fb8841553c0 0x7fb88415edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:33470/0 (socket says 172.21.15.191:33470) 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb882ffd640 1 -- 172.21.15.191:0/3050118954 learned_addr learned my addr 172.21.15.191:0/3050118954 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb881ffb640 1 -- 172.21.15.191:0/3050118954 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544630065 0 0) 0x7fb8840c5c80 con 0x7fb8840cbae0 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb881ffb640 1 -- 172.21.15.191:0/3050118954 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb870003520 con 0x7fb8840cbae0 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8827fc640 1 -- 172.21.15.191:0/3050118954 >> v1:172.21.15.191:6789/0 conn(0x7fb8841553c0 legacy=0x7fb88415edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8827fc640 1 -- 172.21.15.191:0/3050118954 >> v1:172.21.15.155:6789/0 conn(0x7fb8840cbae0 legacy=0x7fb8840d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.486 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.485+0000 7fb8827fc640 1 -- 172.21.15.191:0/3050118954 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88415b8b0 con 0x7fb88415b070 2024-04-25T13:15:58.487 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.486+0000 7fb8827fc640 1 --2- 172.21.15.191:0/3050118954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb88415b070 0x7fb8840cb5a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb874009790 tx=0x7fb87402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a237744f448ebf6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.490 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.488+0000 7fb881ffb640 1 -- 172.21.15.191:0/3050118954 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874037070 con 0x7fb88415b070 2024-04-25T13:15:58.490 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.488+0000 7fb881ffb640 1 -- 172.21.15.191:0/3050118954 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb874032440 con 0x7fb88415b070 2024-04-25T13:15:58.490 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.488+0000 7fb881ffb640 1 -- 172.21.15.191:0/3050118954 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874032810 con 0x7fb88415b070 2024-04-25T13:15:58.490 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 -- 172.21.15.191:0/3050118954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb88415b070 msgr2=0x7fb8840cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.491 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 --2- 172.21.15.191:0/3050118954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb88415b070 0x7fb8840cb5a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb874009790 tx=0x7fb87402a210 comp rx=0 tx=0).stop 2024-04-25T13:15:58.491 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 -- 172.21.15.191:0/3050118954 shutdown_connections 2024-04-25T13:15:58.491 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 --2- 172.21.15.191:0/3050118954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb88415b070 0x7fb8840cb5a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.491 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 -- 172.21.15.191:0/3050118954 >> 172.21.15.191:0/3050118954 conn(0x7fb884072360 msgr2=0x7fb884074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.491 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 -- 172.21.15.191:0/3050118954 shutdown_connections 2024-04-25T13:15:58.491 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.489+0000 7fb8892cf640 1 -- 172.21.15.191:0/3050118954 wait complete. 2024-04-25T13:15:58.496 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 Processor -- start 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 -- start start 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8840cbae0 0x7fb8840693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 0x7fb88415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 0x7fb884150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb88415be70 con 0x7fb8840cbae0 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841557a0 con 0x7fb8841553c0 2024-04-25T13:15:58.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8892cf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb88415e8b0 con 0x7fb88415b070 2024-04-25T13:15:58.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 0x7fb884150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8827fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 0x7fb88415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8827fc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 0x7fb88415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49660/0 (socket says 172.21.15.191:49660) 2024-04-25T13:15:58.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8837fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 0x7fb884150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:59246/0 (socket says 172.21.15.191:59246) 2024-04-25T13:15:58.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb8827fc640 1 -- 172.21.15.191:0/3610157269 learned_addr learned my addr 172.21.15.191:0/3610157269 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.491+0000 7fb882ffd640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8840cbae0 0x7fb8840693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8837fe640 1 -- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 msgr2=0x7fb88415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8837fe640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 0x7fb88415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8837fe640 1 -- 172.21.15.191:0/3610157269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8840cbae0 msgr2=0x7fb8840693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8837fe640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8840cbae0 0x7fb8840693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8837fe640 1 -- 172.21.15.191:0/3610157269 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb884153300 con 0x7fb88415b070 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb882ffd640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8840cbae0 0x7fb8840693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8827fc640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 0x7fb88415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8837fe640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 0x7fb884150e90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c760 tx=0x7fb87c00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c003b70 con 0x7fb88415b070 2024-04-25T13:15:58.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c003d30 con 0x7fb88415b070 2024-04-25T13:15:58.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8841535e0 con 0x7fb88415b070 2024-04-25T13:15:58.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c00aa90 con 0x7fb88415b070 2024-04-25T13:15:58.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb884150690 con 0x7fb88415b070 2024-04-25T13:15:58.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb87c00ac30 con 0x7fb88415b070 2024-04-25T13:15:58.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.492+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb87c012930 con 0x7fb88415b070 2024-04-25T13:15:58.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.493+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb884068f50 con 0x7fb88415b070 2024-04-25T13:15:58.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.495+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb87c012510 con 0x7fb88415b070 2024-04-25T13:15:58.568 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.568+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "493b0471-6e11-4379-b815-b7693e3fe47e", "id": 2} v 0) -- 0x7fb8840cc0e0 con 0x7fb88415b070 2024-04-25T13:15:58.571 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.571+0000 7fb87b7fe640 1 -- 172.21.15.191:0/3610157269 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "493b0471-6e11-4379-b815-b7693e3fe47e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb87c012bd0 con 0x7fb88415b070 2024-04-25T13:15:58.571 INFO:teuthology.orchestra.run.smithi191.stdout:2 2024-04-25T13:15:58.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 msgr2=0x7fb884150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 0x7fb884150e90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c760 tx=0x7fb87c00cc20 comp rx=0 tx=0).stop 2024-04-25T13:15:58.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 shutdown_connections 2024-04-25T13:15:58.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb88415b070 0x7fb884150e90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb8841553c0 0x7fb88415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.573 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 --2- 172.21.15.191:0/3610157269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8840cbae0 0x7fb8840693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.574 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 >> 172.21.15.191:0/3610157269 conn(0x7fb884072360 msgr2=0x7fb8840c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.574 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 shutdown_connections 2024-04-25T13:15:58.574 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.572+0000 7fb8892cf640 1 -- 172.21.15.191:0/3610157269 wait complete. 2024-04-25T13:15:58.583 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 41c21def-1bb7-40b4-9a6a-1695e2a0def5 3 2024-04-25T13:15:58.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.680+0000 7f90df6dc640 1 Processor -- start 2024-04-25T13:15:58.681 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.681+0000 7f90df6dc640 1 -- start start 2024-04-25T13:15:58.689 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.681+0000 7f90df6dc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f90d80cbc90 0x7f90d815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.690 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.681+0000 7f90df6dc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f90d8073ef0 0x7f90d80ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.690 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.681+0000 7f90df6dc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d815ce00 con 0x7f90d815a5c0 2024-04-25T13:15:58.690 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.681+0000 7f90df6dc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f90d8159650 con 0x7f90d80cbc90 2024-04-25T13:15:58.690 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.681+0000 7f90df6dc640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f90d815d0e0 con 0x7f90d8073ef0 2024-04-25T13:15:58.690 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f90d8073ef0 0x7f90d80ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f90d8073ef0 0x7f90d80ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49666/0 (socket says 172.21.15.191:49666) 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 -- 172.21.15.191:0/2133810185 learned_addr learned my addr 172.21.15.191:0/2133810185 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90dd478640 1 --2- 172.21.15.191:0/2133810185 >> v2:172.21.15.155:3300/0 conn(0x7f90d80cbc90 0x7f90d815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 -- 172.21.15.191:0/2133810185 >> v2:172.21.15.155:3300/0 conn(0x7f90d80cbc90 msgr2=0x7f90d815c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 --2- 172.21.15.191:0/2133810185 >> v2:172.21.15.155:3300/0 conn(0x7f90d80cbc90 0x7f90d815c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 -- 172.21.15.191:0/2133810185 >> v1:172.21.15.155:6789/0 conn(0x7f90d815a5c0 legacy=0x7f90d8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.691 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 -- 172.21.15.191:0/2133810185 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d815d3c0 con 0x7f90d8073ef0 2024-04-25T13:15:58.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.682+0000 7f90ddc79640 1 --2- 172.21.15.191:0/2133810185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d80ce750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009e50 tx=0x7f90d002a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb588d3b77e1130f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90cffff640 1 -- 172.21.15.191:0/2133810185 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0036070 con 0x7f90d8073ef0 2024-04-25T13:15:58.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90cffff640 1 -- 172.21.15.191:0/2133810185 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d0031600 con 0x7f90d8073ef0 2024-04-25T13:15:58.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90cffff640 1 -- 172.21.15.191:0/2133810185 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d00319d0 con 0x7f90d8073ef0 2024-04-25T13:15:58.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 -- 172.21.15.191:0/2133810185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 msgr2=0x7f90d80ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.692 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2133810185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d80ce750 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009e50 tx=0x7f90d002a760 comp rx=0 tx=0).stop 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 -- 172.21.15.191:0/2133810185 shutdown_connections 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2133810185 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d80ce750 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2133810185 >> v2:172.21.15.155:3300/0 conn(0x7f90d80cbc90 0x7f90d815c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 -- 172.21.15.191:0/2133810185 >> 172.21.15.191:0/2133810185 conn(0x7f90d806f840 msgr2=0x7f90d8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 -- 172.21.15.191:0/2133810185 shutdown_connections 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.683+0000 7f90df6dc640 1 -- 172.21.15.191:0/2133810185 wait complete. 2024-04-25T13:15:58.693 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.684+0000 7f90df6dc640 1 Processor -- start 2024-04-25T13:15:58.694 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 -- start start 2024-04-25T13:15:58.694 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d8151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.694 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90d80cbc90 0x7f90d80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.694 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90d815a5c0 0x7f90d8157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.694 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80c5850 con 0x7f90d815a5c0 2024-04-25T13:15:58.694 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80cc070 con 0x7f90d8073ef0 2024-04-25T13:15:58.695 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90df6dc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f90d80c59d0 con 0x7f90d80cbc90 2024-04-25T13:15:58.695 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90dd478640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d8151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.695 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90dd478640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d8151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49672/0 (socket says 172.21.15.191:49672) 2024-04-25T13:15:58.695 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90dd478640 1 -- 172.21.15.191:0/2208278736 learned_addr learned my addr 172.21.15.191:0/2208278736 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.695 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90dcc77640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90d80cbc90 0x7f90d80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.695 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.685+0000 7f90ddc79640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90d815a5c0 0x7f90d8157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.696 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dcc77640 1 -- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 msgr2=0x7f90d8151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.696 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dcc77640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d8151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.696 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dcc77640 1 -- 172.21.15.191:0/2208278736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90d815a5c0 msgr2=0x7f90d8157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.696 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dcc77640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90d815a5c0 0x7f90d8157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.696 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dcc77640 1 -- 172.21.15.191:0/2208278736 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d81570e0 con 0x7f90d80cbc90 2024-04-25T13:15:58.696 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dd478640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d8151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.697 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90dcc77640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90d80cbc90 0x7f90d80cda90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c340 tx=0x7f90c800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.697 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c80052d0 con 0x7f90d80cbc90 2024-04-25T13:15:58.697 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8005490 con 0x7f90d80cbc90 2024-04-25T13:15:58.697 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8007260 con 0x7f90d80cbc90 2024-04-25T13:15:58.697 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d814df30 con 0x7f90d80cbc90 2024-04-25T13:15:58.697 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f90c8007400 con 0x7f90d80cbc90 2024-04-25T13:15:58.698 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d814e4f0 con 0x7f90d80cbc90 2024-04-25T13:15:58.698 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.686+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f90c8003650 con 0x7f90d80cbc90 2024-04-25T13:15:58.698 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.687+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d8068f50 con 0x7f90d80cbc90 2024-04-25T13:15:58.698 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.689+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f90c8020070 con 0x7f90d80cbc90 2024-04-25T13:15:58.761 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.761+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "41c21def-1bb7-40b4-9a6a-1695e2a0def5", "id": 3} v 0) -- 0x7f90d80c9300 con 0x7f90d80cbc90 2024-04-25T13:15:58.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.764+0000 7f90cdffb640 1 -- 172.21.15.191:0/2208278736 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "41c21def-1bb7-40b4-9a6a-1695e2a0def5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f90c8003b40 con 0x7f90d80cbc90 2024-04-25T13:15:58.765 INFO:teuthology.orchestra.run.smithi191.stdout:3 2024-04-25T13:15:58.766 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90d80cbc90 msgr2=0x7f90d80cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.766 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90d80cbc90 0x7f90d80cda90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c340 tx=0x7f90c800c800 comp rx=0 tx=0).stop 2024-04-25T13:15:58.767 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 shutdown_connections 2024-04-25T13:15:58.767 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90d815a5c0 0x7f90d8157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.767 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f90d80cbc90 0x7f90d80cda90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.767 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 --2- 172.21.15.191:0/2208278736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90d8073ef0 0x7f90d8151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.767 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 >> 172.21.15.191:0/2208278736 conn(0x7f90d806f840 msgr2=0x7f90d80ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.767 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 shutdown_connections 2024-04-25T13:15:58.768 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.765+0000 7f90df6dc640 1 -- 172.21.15.191:0/2208278736 wait complete. 2024-04-25T13:15:58.776 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new b9674f31-0811-422e-a137-db684b8a7814 4 2024-04-25T13:15:58.848 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:58.848+0000 7fa76c579040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:15:58.855 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:58.855+0000 7f9653921040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:15:58.883 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.874+0000 7f2526d07640 1 Processor -- start 2024-04-25T13:15:58.883 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.874+0000 7f2526d07640 1 -- start start 2024-04-25T13:15:58.884 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2526d07640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 0x7f252015c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.884 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2526d07640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f252015a5c0 0x7f2520159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.884 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2526d07640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 0x7f25200ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.884 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2526d07640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2520159650 con 0x7f252015a5c0 2024-04-25T13:15:58.884 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2526d07640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f252015ce00 con 0x7f25200cbc90 2024-04-25T13:15:58.884 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2526d07640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f252015d0e0 con 0x7f2520073ef0 2024-04-25T13:15:58.885 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 0x7f25200ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.885 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2524aa3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 0x7f252015c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.885 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 0x7f25200ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:59260/0 (socket says 172.21.15.191:59260) 2024-04-25T13:15:58.885 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2524aa3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 0x7f252015c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49676/0 (socket says 172.21.15.191:49676) 2024-04-25T13:15:58.885 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 -- 172.21.15.191:0/805298107 learned_addr learned my addr 172.21.15.191:0/805298107 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.885 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f251ffff640 1 --2- 172.21.15.191:0/805298107 >> v2:172.21.15.155:3300/0 conn(0x7f252015a5c0 0x7f2520159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.886 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 -- 172.21.15.191:0/805298107 >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 msgr2=0x7f252015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:58.886 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 --2- 172.21.15.191:0/805298107 >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 0x7f252015c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.886 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 -- 172.21.15.191:0/805298107 >> v2:172.21.15.155:3300/0 conn(0x7f252015a5c0 msgr2=0x7f2520159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:58.886 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 --2- 172.21.15.191:0/805298107 >> v2:172.21.15.155:3300/0 conn(0x7f252015a5c0 0x7f2520159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.886 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f25252a4640 1 -- 172.21.15.191:0/805298107 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252015d3c0 con 0x7f2520073ef0 2024-04-25T13:15:58.886 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.875+0000 7f2524aa3640 1 --2- 172.21.15.191:0/805298107 >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 0x7f252015c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.876+0000 7f25252a4640 1 --2- 172.21.15.191:0/805298107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 0x7f25200ce750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e50 tx=0x7f251802a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676766314d304f79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.876+0000 7f251f7fe640 1 -- 172.21.15.191:0/805298107 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518036070 con 0x7f2520073ef0 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.876+0000 7f251f7fe640 1 -- 172.21.15.191:0/805298107 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2518031600 con 0x7f2520073ef0 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.876+0000 7f251f7fe640 1 -- 172.21.15.191:0/805298107 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25180319d0 con 0x7f2520073ef0 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 -- 172.21.15.191:0/805298107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 msgr2=0x7f25200ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 --2- 172.21.15.191:0/805298107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 0x7f25200ce750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2518009e50 tx=0x7f251802a750 comp rx=0 tx=0).stop 2024-04-25T13:15:58.887 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 -- 172.21.15.191:0/805298107 shutdown_connections 2024-04-25T13:15:58.888 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 --2- 172.21.15.191:0/805298107 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2520073ef0 0x7f25200ce750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.888 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 --2- 172.21.15.191:0/805298107 >> v2:172.21.15.155:3300/0 conn(0x7f252015a5c0 0x7f2520159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.888 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 --2- 172.21.15.191:0/805298107 >> v2:172.21.15.191:3300/0 conn(0x7f25200cbc90 0x7f252015c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.888 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 -- 172.21.15.191:0/805298107 >> 172.21.15.191:0/805298107 conn(0x7f252006f840 msgr2=0x7f2520074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.888 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 -- 172.21.15.191:0/805298107 shutdown_connections 2024-04-25T13:15:58.888 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.877+0000 7f2526d07640 1 -- 172.21.15.191:0/805298107 wait complete. 2024-04-25T13:15:58.889 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.878+0000 7f2526d07640 1 Processor -- start 2024-04-25T13:15:58.889 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.878+0000 7f2526d07640 1 -- start start 2024-04-25T13:15:58.889 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2526d07640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2520073ef0 0x7f25201f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.889 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2526d07640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25200cbc90 0x7f252014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.889 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2526d07640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 0x7f25201e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:58.890 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2526d07640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f252015a020 con 0x7f2520073ef0 2024-04-25T13:15:58.890 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2526d07640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f25200cc070 con 0x7f25200cbc90 2024-04-25T13:15:58.890 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2526d07640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f25200c5850 con 0x7f252015a5c0 2024-04-25T13:15:58.890 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 0x7f25201e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.890 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f251ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25200cbc90 0x7f252014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.890 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 0x7f25201e59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:59274/0 (socket says 172.21.15.191:59274) 2024-04-25T13:15:58.891 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 -- 172.21.15.191:0/1674857196 learned_addr learned my addr 172.21.15.191:0/1674857196 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:58.891 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f2524aa3640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2520073ef0 0x7f25201f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:58.891 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 -- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25200cbc90 msgr2=0x7f252014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.891 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25200cbc90 0x7f252014ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.891 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 -- 172.21.15.191:0/1674857196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2520073ef0 msgr2=0x7f25201f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.892 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2520073ef0 0x7f25201f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.892 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 -- 172.21.15.191:0/1674857196 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25201ef090 con 0x7f252015a5c0 2024-04-25T13:15:58.892 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f251ffff640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25200cbc90 0x7f252014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:58.892 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f25252a4640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 0x7f25201e59d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2518009f70 tx=0x7f2518004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:58.892 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251803f020 con 0x7f252015a5c0 2024-04-25T13:15:58.892 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.879+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2518037040 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.880+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518036070 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.880+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25201ef370 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.880+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25201ef930 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.880+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2518042020 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.880+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2518044b40 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.880+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2520068f50 con 0x7f252015a5c0 2024-04-25T13:15:58.893 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.882+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2518049030 con 0x7f252015a5c0 2024-04-25T13:15:58.935 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:58.935+0000 7fa76c579040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:58.947 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:58.947+0000 7f9653921040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:15:58.955 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.955+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b9674f31-0811-422e-a137-db684b8a7814", "id": 4} v 0) -- 0x7f25200c9300 con 0x7f252015a5c0 2024-04-25T13:15:58.958 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.958+0000 7f251d7fa640 1 -- 172.21.15.191:0/1674857196 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9674f31-0811-422e-a137-db684b8a7814", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2518044d90 con 0x7f252015a5c0 2024-04-25T13:15:58.959 INFO:teuthology.orchestra.run.smithi191.stdout:4 2024-04-25T13:15:58.960 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 msgr2=0x7f25201e59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:58.960 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 0x7f25201e59d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2518009f70 tx=0x7f2518004a40 comp rx=0 tx=0).stop 2024-04-25T13:15:58.961 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 shutdown_connections 2024-04-25T13:15:58.961 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f252015a5c0 0x7f25201e59d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.961 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f25200cbc90 0x7f252014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.961 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 --2- 172.21.15.191:0/1674857196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2520073ef0 0x7f25201f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:58.961 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 >> 172.21.15.191:0/1674857196 conn(0x7f252006f840 msgr2=0x7f252015c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:58.961 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 shutdown_connections 2024-04-25T13:15:58.962 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:58.959+0000 7f2526d07640 1 -- 172.21.15.191:0/1674857196 wait complete. 2024-04-25T13:15:58.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 6b89ca33-6982-4889-9d63-91043b7a33cf 5 2024-04-25T13:15:58.977 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:58.978+0000 7fa76c579040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:15:58.993 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:58.993+0000 7f9653921040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:15:59.077 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.067+0000 7f5884b87640 1 Processor -- start 2024-04-25T13:15:59.077 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.067+0000 7f5884b87640 1 -- start start 2024-04-25T13:15:59.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f5884b87640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5880151e90 0x7f58800cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f5884b87640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f58800c9ff0 0x7f58800ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f5884b87640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58801580a0 con 0x7f588015b880 2024-04-25T13:15:59.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f5884b87640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f58800cc180 con 0x7f58800c9ff0 2024-04-25T13:15:59.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f5884b87640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f588015b3f0 con 0x7f5880151e90 2024-04-25T13:15:59.078 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587e59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5880151e90 0x7f58800cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587ed9d640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f588015b880 0x7f588015bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:33486/0 (socket says 172.21.15.191:33486) 2024-04-25T13:15:59.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587ed9d640 1 -- 172.21.15.191:0/2865964624 learned_addr learned my addr 172.21.15.191:0/2865964624 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-25T13:15:59.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587dd9b640 1 --2- 172.21.15.191:0/2865964624 >> v2:172.21.15.155:3300/0 conn(0x7f58800c9ff0 0x7f58800ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587e59c640 1 -- 172.21.15.191:0/2865964624 >> v2:172.21.15.155:3300/0 conn(0x7f58800c9ff0 msgr2=0x7f58800ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:59.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587e59c640 1 --2- 172.21.15.191:0/2865964624 >> v2:172.21.15.155:3300/0 conn(0x7f58800c9ff0 0x7f58800ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.079 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587e59c640 1 -- 172.21.15.191:0/2865964624 >> v1:172.21.15.191:6789/0 conn(0x7f588015b880 legacy=0x7f588015bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.080 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587d59a640 1 -- 172.21.15.191:0/2865964624 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946790602 0 0) 0x7f58801580a0 con 0x7f588015b880 2024-04-25T13:15:59.080 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587e59c640 1 -- 172.21.15.191:0/2865964624 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5880158380 con 0x7f5880151e90 2024-04-25T13:15:59.080 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.068+0000 7f587dd9b640 1 --2- 172.21.15.191:0/2865964624 >> v2:172.21.15.155:3300/0 conn(0x7f58800c9ff0 0x7f58800ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:15:59.080 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.069+0000 7f587e59c640 1 --2- 172.21.15.191:0/2865964624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5880151e90 0x7f58800cbc40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba40 tx=0x7f587002c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ab885a825d6617 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.080 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.069+0000 7f587d59a640 1 -- 172.21.15.191:0/2865964624 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58700327d0 con 0x7f5880151e90 2024-04-25T13:15:59.080 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.069+0000 7f587d59a640 1 -- 172.21.15.191:0/2865964624 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5870038070 con 0x7f5880151e90 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.069+0000 7f587d59a640 1 -- 172.21.15.191:0/2865964624 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870032b90 con 0x7f5880151e90 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 -- 172.21.15.191:0/2865964624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5880151e90 msgr2=0x7f58800cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 --2- 172.21.15.191:0/2865964624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5880151e90 0x7f58800cbc40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f587000ba40 tx=0x7f587002c8d0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 -- 172.21.15.191:0/2865964624 shutdown_connections 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 --2- 172.21.15.191:0/2865964624 >> v2:172.21.15.155:3300/0 conn(0x7f58800c9ff0 0x7f58800ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 --2- 172.21.15.191:0/2865964624 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5880151e90 0x7f58800cbc40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.081 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 -- 172.21.15.191:0/2865964624 >> 172.21.15.191:0/2865964624 conn(0x7f588006b920 msgr2=0x7f588006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.082 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 -- 172.21.15.191:0/2865964624 shutdown_connections 2024-04-25T13:15:59.082 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.070+0000 7f5884b87640 1 -- 172.21.15.191:0/2865964624 wait complete. 2024-04-25T13:15:59.082 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.071+0000 7f5884b87640 1 Processor -- start 2024-04-25T13:15:59.082 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.071+0000 7f5884b87640 1 -- start start 2024-04-25T13:15:59.082 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 0x7f5880159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.082 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5880151e90 0x7f588014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f588015b880 0x7f58801f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5880158940 con 0x7f5880151e90 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5880152270 con 0x7f588015b880 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5880158c20 con 0x7f58800c9ff0 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 0x7f5880159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 0x7f5880159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:59302/0 (socket says 172.21.15.191:59302) 2024-04-25T13:15:59.083 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 -- 172.21.15.191:0/1156662069 learned_addr learned my addr 172.21.15.191:0/1156662069 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:59.084 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587ed9d640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f588015b880 0x7f58801f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.084 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587dd9b640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5880151e90 0x7f588014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.084 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 -- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f588015b880 msgr2=0x7f58801f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.084 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f588015b880 0x7f58801f45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.084 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 -- 172.21.15.191:0/1156662069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5880151e90 msgr2=0x7f588014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.084 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5880151e90 0x7f588014cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 -- 172.21.15.191:0/1156662069 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588014d250 con 0x7f58800c9ff0 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f587e59c640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 0x7f5880159ee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f587000bb60 tx=0x7f5870004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870006e10 con 0x7f58800c9ff0 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5870042070 con 0x7f58800c9ff0 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587003c3f0 con 0x7f58800c9ff0 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.072+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588014d530 con 0x7f58800c9ff0 2024-04-25T13:15:59.085 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.073+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58801596e0 con 0x7f58800c9ff0 2024-04-25T13:15:59.086 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.073+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f587003c920 con 0x7f58800c9ff0 2024-04-25T13:15:59.086 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.073+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f5870047af0 con 0x7f58800c9ff0 2024-04-25T13:15:59.086 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.073+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58800ca530 con 0x7f58800c9ff0 2024-04-25T13:15:59.086 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.075+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f58800ca530 con 0x7f58800c9ff0 2024-04-25T13:15:59.142 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:59.142+0000 7fa76c579040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:15:59.147 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.147+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b89ca33-6982-4889-9d63-91043b7a33cf", "id": 5} v 0) -- 0x7f5880068f50 con 0x7f58800c9ff0 2024-04-25T13:15:59.151 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.151+0000 7f586effd640 1 -- 172.21.15.191:0/1156662069 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b89ca33-6982-4889-9d63-91043b7a33cf", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f587003cda0 con 0x7f58800c9ff0 2024-04-25T13:15:59.152 INFO:teuthology.orchestra.run.smithi191.stdout:5 2024-04-25T13:15:59.154 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 msgr2=0x7f5880159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.154 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 0x7f5880159ee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f587000bb60 tx=0x7f5870004730 comp rx=0 tx=0).stop 2024-04-25T13:15:59.154 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 shutdown_connections 2024-04-25T13:15:59.155 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f588015b880 0x7f58801f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.155 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5880151e90 0x7f588014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.155 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 --2- 172.21.15.191:0/1156662069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f58800c9ff0 0x7f5880159ee0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.155 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 >> 172.21.15.191:0/1156662069 conn(0x7f588006b920 msgr2=0x7f588006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.155 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 shutdown_connections 2024-04-25T13:15:59.155 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.152+0000 7f5884b87640 1 -- 172.21.15.191:0/1156662069 wait complete. 2024-04-25T13:15:59.163 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 34e96272-8cb2-4ee7-afc9-8266df39e33e 6 2024-04-25T13:15:59.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:59.167+0000 7f9653921040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:15:59.190 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:59.190+0000 7fa76c579040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:15:59.228 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:59.228+0000 7f9653921040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:15:59.242 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:59.242+0000 7fa76c579040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:15:59.264 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.264+0000 7fd04ea9a640 1 Processor -- start 2024-04-25T13:15:59.265 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.264+0000 7fd04ea9a640 1 -- start start 2024-04-25T13:15:59.272 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04ea9a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd048155300 0x7fd04806b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04ea9a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0480ca420 con 0x7fd0480c9b00 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04ea9a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0480ca700 con 0x7fd04806be60 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04ea9a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd0480cafa0 con 0x7fd048155300 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04c836640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd048155300 0x7fd04806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04d037640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fd04806be60 0x7fd04815e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:33490/0 (socket says 172.21.15.191:33490) 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04d037640 1 -- 172.21.15.191:0/1433961677 learned_addr learned my addr 172.21.15.191:0/1433961677 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-25T13:15:59.273 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04c836640 1 -- 172.21.15.191:0/1433961677 >> v1:172.21.15.191:6789/0 conn(0x7fd04806be60 legacy=0x7fd04815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.274 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04c836640 1 -- 172.21.15.191:0/1433961677 >> v1:172.21.15.155:6789/0 conn(0x7fd0480c9b00 legacy=0x7fd048073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.274 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.265+0000 7fd04c836640 1 -- 172.21.15.191:0/1433961677 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0480ca9e0 con 0x7fd048155300 2024-04-25T13:15:59.274 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.266+0000 7fd04c836640 1 --2- 172.21.15.191:0/1433961677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd048155300 0x7fd04806b920 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0440097a0 tx=0x7fd04402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7eae8405edc513 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.274 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.266+0000 7fd03f7fe640 1 -- 172.21.15.191:0/1433961677 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044037070 con 0x7fd048155300 2024-04-25T13:15:59.274 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.266+0000 7fd03f7fe640 1 -- 172.21.15.191:0/1433961677 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044032440 con 0x7fd048155300 2024-04-25T13:15:59.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.266+0000 7fd03f7fe640 1 -- 172.21.15.191:0/1433961677 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044032810 con 0x7fd048155300 2024-04-25T13:15:59.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 -- 172.21.15.191:0/1433961677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd048155300 msgr2=0x7fd04806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 --2- 172.21.15.191:0/1433961677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd048155300 0x7fd04806b920 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0440097a0 tx=0x7fd04402a1a0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 -- 172.21.15.191:0/1433961677 shutdown_connections 2024-04-25T13:15:59.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 --2- 172.21.15.191:0/1433961677 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd048155300 0x7fd04806b920 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.275 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 -- 172.21.15.191:0/1433961677 >> 172.21.15.191:0/1433961677 conn(0x7fd048074d50 msgr2=0x7fd048075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 -- 172.21.15.191:0/1433961677 shutdown_connections 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.267+0000 7fd04ea9a640 1 -- 172.21.15.191:0/1433961677 wait complete. 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.268+0000 7fd04ea9a640 1 Processor -- start 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.268+0000 7fd04ea9a640 1 -- start start 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04ea9a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd04806be60 0x7fd048159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04ea9a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480c9b00 0x7fd0481f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.276 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04ea9a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd048155300 0x7fd04815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.277 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04ea9a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd048074150 con 0x7fd04806be60 2024-04-25T13:15:59.277 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04ea9a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd0481556e0 con 0x7fd0480c9b00 2024-04-25T13:15:59.277 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04ea9a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd0480742d0 con 0x7fd048155300 2024-04-25T13:15:59.277 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd03ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480c9b00 0x7fd0481f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.277 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd048155300 0x7fd04815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.277 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd03ffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480c9b00 0x7fd0481f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:49694/0 (socket says 172.21.15.191:49694) 2024-04-25T13:15:59.278 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd03ffff640 1 -- 172.21.15.191:0/2977358649 learned_addr learned my addr 172.21.15.191:0/2977358649 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:59.278 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04c836640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd04806be60 0x7fd048159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.278 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 -- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480c9b00 msgr2=0x7fd0481f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.278 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480c9b00 0x7fd0481f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.278 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 -- 172.21.15.191:0/2977358649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd04806be60 msgr2=0x7fd048159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.278 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd04806be60 0x7fd048159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 -- 172.21.15.191:0/2977358649 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04814b530 con 0x7fd048155300 2024-04-25T13:15:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd04d037640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd048155300 0x7fd04815eac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd04000cad0 tx=0x7fd04000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040017070 con 0x7fd048155300 2024-04-25T13:15:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.269+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd04000ab40 con 0x7fd048155300 2024-04-25T13:15:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.270+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd048158f40 con 0x7fd048155300 2024-04-25T13:15:59.279 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.270+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040012400 con 0x7fd048155300 2024-04-25T13:15:59.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.270+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd048159500 con 0x7fd048155300 2024-04-25T13:15:59.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.270+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd04001a070 con 0x7fd048155300 2024-04-25T13:15:59.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.270+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd04001ccb0 con 0x7fd048155300 2024-04-25T13:15:59.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.270+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd048068f50 con 0x7fd048155300 2024-04-25T13:15:59.280 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.272+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd04001c6c0 con 0x7fd048155300 2024-04-25T13:15:59.283 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:59.284+0000 7f9653921040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:15:59.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.344+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd new", "uuid": "34e96272-8cb2-4ee7-afc9-8266df39e33e", "id": 6} v 0) -- 0x7fd0480cef50 con 0x7fd048155300 2024-04-25T13:15:59.348 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.348+0000 7fd03d7fa640 1 -- 172.21.15.191:0/2977358649 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34e96272-8cb2-4ee7-afc9-8266df39e33e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd04001c970 con 0x7fd048155300 2024-04-25T13:15:59.349 INFO:teuthology.orchestra.run.smithi191.stdout:6 2024-04-25T13:15:59.350 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd048155300 msgr2=0x7fd04815eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.351 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd048155300 0x7fd04815eac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd04000cad0 tx=0x7fd04000cf90 comp rx=0 tx=0).stop 2024-04-25T13:15:59.351 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 shutdown_connections 2024-04-25T13:15:59.351 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd048155300 0x7fd04815eac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.351 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0480c9b00 0x7fd0481f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.351 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 --2- 172.21.15.191:0/2977358649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd04806be60 0x7fd048159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.351 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 >> 172.21.15.191:0/2977358649 conn(0x7fd048074d50 msgr2=0x7fd048070880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 shutdown_connections 2024-04-25T13:15:59.352 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.349+0000 7fd04ea9a640 1 -- 172.21.15.191:0/2977358649 wait complete. 2024-04-25T13:15:59.354 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:59.354+0000 7fa76c579040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:59.361 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new fd957394-6698-435b-aaa2-36c622cefd45 7 2024-04-25T13:15:59.402 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:59.403+0000 7f9653921040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:15:59.458 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.458+0000 7fa38a34a640 1 Processor -- start 2024-04-25T13:15:59.458 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.458+0000 7fa38a34a640 1 -- start start 2024-04-25T13:15:59.460 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa38a34a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa3840c6030 0x7fa3840c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.460 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa38a34a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa3840c6410 0x7fa38406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.460 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa38a34a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38406fd10 con 0x7fa38406f810 2024-04-25T13:15:59.460 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa38a34a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa3840cadb0 con 0x7fa3840c6410 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa38a34a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa3840cb090 con 0x7fa3840c6030 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa383fff640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa3840c6030 0x7fa3840c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa3888e7640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fa38406f810 0x7fa38415c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.191:33504/0 (socket says 172.21.15.191:33504) 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa3888e7640 1 -- 172.21.15.191:0/3576973705 learned_addr learned my addr 172.21.15.191:0/3576973705 (peer_addr_for_me v1:172.21.15.191:0/0) 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa3837fe640 1 --2- 172.21.15.191:0/3576973705 >> v2:172.21.15.155:3300/0 conn(0x7fa3840c6410 0x7fa38406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.459+0000 7fa382ffd640 1 -- 172.21.15.191:0/3576973705 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276104517 0 0) 0x7fa38406fd10 con 0x7fa38406f810 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa382ffd640 1 -- 172.21.15.191:0/3576973705 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa36c003520 con 0x7fa38406f810 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa383fff640 1 -- 172.21.15.191:0/3576973705 >> v2:172.21.15.155:3300/0 conn(0x7fa3840c6410 msgr2=0x7fa38406f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa383fff640 1 --2- 172.21.15.191:0/3576973705 >> v2:172.21.15.155:3300/0 conn(0x7fa3840c6410 0x7fa38406f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa383fff640 1 -- 172.21.15.191:0/3576973705 >> v1:172.21.15.191:6789/0 conn(0x7fa38406f810 legacy=0x7fa38415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa383fff640 1 -- 172.21.15.191:0/3576973705 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3840cb370 con 0x7fa3840c6030 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa383fff640 1 --2- 172.21.15.191:0/3576973705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6030 0x7fa3840c89c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa384071ec0 tx=0x7fa37802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d003daec1a42a0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa382ffd640 1 -- 172.21.15.191:0/3576973705 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378037070 con 0x7fa3840c6030 2024-04-25T13:15:59.461 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa382ffd640 1 -- 172.21.15.191:0/3576973705 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa378032440 con 0x7fa3840c6030 2024-04-25T13:15:59.462 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.460+0000 7fa382ffd640 1 -- 172.21.15.191:0/3576973705 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378032810 con 0x7fa3840c6030 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 -- 172.21.15.191:0/3576973705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6030 msgr2=0x7fa3840c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 --2- 172.21.15.191:0/3576973705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6030 0x7fa3840c89c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa384071ec0 tx=0x7fa37802a230 comp rx=0 tx=0).stop 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 -- 172.21.15.191:0/3576973705 shutdown_connections 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 --2- 172.21.15.191:0/3576973705 >> v2:172.21.15.155:3300/0 conn(0x7fa3840c6410 0x7fa38406f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 --2- 172.21.15.191:0/3576973705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6030 0x7fa3840c89c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 -- 172.21.15.191:0/3576973705 >> 172.21.15.191:0/3576973705 conn(0x7fa384074d50 msgr2=0x7fa384075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 -- 172.21.15.191:0/3576973705 shutdown_connections 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.461+0000 7fa38a34a640 1 -- 172.21.15.191:0/3576973705 wait complete. 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.462+0000 7fa38a34a640 1 Processor -- start 2024-04-25T13:15:59.463 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.462+0000 7fa38a34a640 1 -- start start 2024-04-25T13:15:59.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa38a34a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 0x7fa38415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa38a34a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3840c6030 0x7fa3841f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.465 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa38a34a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6410 0x7fa384156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa38a34a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa38415cbb0 con 0x7fa3840c6030 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa38a34a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa3840cb930 con 0x7fa3840c6410 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa38a34a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa38415cd30 con 0x7fa38406f810 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa383fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 0x7fa38415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa3888e7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6410 0x7fa384156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa383fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 0x7fa38415b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.191:59312/0 (socket says 172.21.15.191:59312) 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa383fff640 1 -- 172.21.15.191:0/726871876 learned_addr learned my addr 172.21.15.191:0/726871876 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.463+0000 7fa3837fe640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3840c6030 0x7fa3841f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa3888e7640 1 -- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 msgr2=0x7fa38415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa3888e7640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 0x7fa38415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa3888e7640 1 -- 172.21.15.191:0/726871876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3840c6030 msgr2=0x7fa3841f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa3888e7640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3840c6030 0x7fa3841f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa3888e7640 1 -- 172.21.15.191:0/726871876 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa384157440 con 0x7fa3840c6410 2024-04-25T13:15:59.466 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa383fff640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 0x7fa38415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa3888e7640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6410 0x7fa384156f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00caa0 tx=0x7fa37c00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c017070 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c00ab40 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c012400 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38406cfd0 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38406d290 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa37c01a070 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.464+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa37c01ccd0 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.465+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa384068f50 con 0x7fa3840c6410 2024-04-25T13:15:59.467 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.467+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa37c01c6d0 con 0x7fa3840c6410 2024-04-25T13:15:59.540 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.540+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd957394-6698-435b-aaa2-36c622cefd45", "id": 7} v 0) -- 0x7fa38414f450 con 0x7fa3840c6410 2024-04-25T13:15:59.546 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.546+0000 7fa380ff9640 1 -- 172.21.15.191:0/726871876 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd957394-6698-435b-aaa2-36c622cefd45", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa37c01ca00 con 0x7fa3840c6410 2024-04-25T13:15:59.546 INFO:teuthology.orchestra.run.smithi191.stdout:7 2024-04-25T13:15:59.547 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6410 msgr2=0x7fa384156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6410 0x7fa384156f00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00caa0 tx=0x7fa37c00cea0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 shutdown_connections 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3840c6410 0x7fa384156f00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3840c6030 0x7fa3841f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 --2- 172.21.15.191:0/726871876 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa38406f810 0x7fa38415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 >> 172.21.15.191:0/726871876 conn(0x7fa384074d50 msgr2=0x7fa384075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 shutdown_connections 2024-04-25T13:15:59.548 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-25T13:15:59.547+0000 7fa38a34a640 1 -- 172.21.15.191:0/726871876 wait complete. 2024-04-25T13:15:59.558 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T13:15:59.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T13:15:59.560 INFO:tasks.ceph.osd.0:Started 2024-04-25T13:15:59.561 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T13:15:59.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T13:15:59.565 INFO:tasks.ceph.osd.1:Started 2024-04-25T13:15:59.565 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T13:15:59.565 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T13:15:59.567 INFO:tasks.ceph.osd.2:Started 2024-04-25T13:15:59.567 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T13:15:59.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T13:15:59.570 INFO:tasks.ceph.osd.3:Started 2024-04-25T13:15:59.570 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T13:15:59.570 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T13:15:59.600 INFO:tasks.ceph.osd.4:Started 2024-04-25T13:15:59.600 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T13:15:59.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T13:15:59.602 INFO:tasks.ceph.osd.5:Started 2024-04-25T13:15:59.603 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T13:15:59.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T13:15:59.605 INFO:tasks.ceph.osd.6:Started 2024-04-25T13:15:59.605 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T13:15:59.605 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T13:15:59.607 INFO:tasks.ceph.osd.7:Started 2024-04-25T13:15:59.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:15:59.720 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.720+0000 7f04b0529640 1 Processor -- start 2024-04-25T13:15:59.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 -- start start 2024-04-25T13:15:59.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a81554e0 0x7f04a815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b3c00 0x7f04a80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f04a80b5450 0x7f04a80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f04a80b4a80 con 0x7f04a81554e0 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f04a81558c0 con 0x7f04a80b5450 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.721+0000 7f04b0529640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f04a815f630 con 0x7f04a80b3c00 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a81554e0 0x7f04a815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a81554e0 0x7f04a815f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41682/0 (socket says 172.21.15.155:41682) 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04aeac6640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f04a80b5450 0x7f04a80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04adac4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b3c00 0x7f04a80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 -- 172.21.15.155:0/1672325690 learned_addr learned my addr 172.21.15.155:0/1672325690 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 -- 172.21.15.155:0/1672325690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b3c00 msgr2=0x7f04a80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 --2- 172.21.15.155:0/1672325690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b3c00 0x7f04a80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 -- 172.21.15.155:0/1672325690 >> v2:172.21.15.191:3300/0 conn(0x7f04a80b5450 msgr2=0x7f04a80d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:15:59.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 --2- 172.21.15.155:0/1672325690 >> v2:172.21.15.191:3300/0 conn(0x7f04a80b5450 0x7f04a80d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.722+0000 7f04ae2c5640 1 -- 172.21.15.155:0/1672325690 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a80cb8c0 con 0x7f04a81554e0 2024-04-25T13:15:59.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.723+0000 7f04ae2c5640 1 --2- 172.21.15.155:0/1672325690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a815f0f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04a80caf10 tx=0x7f04a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8100dc44bb2003c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.723+0000 7f04ad2c3640 1 -- 172.21.15.155:0/1672325690 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4037070 con 0x7f04a81554e0 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.723+0000 7f04ad2c3640 1 -- 172.21.15.155:0/1672325690 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a4032440 con 0x7f04a81554e0 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.723+0000 7f04ad2c3640 1 -- 172.21.15.155:0/1672325690 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4032810 con 0x7f04a81554e0 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 -- 172.21.15.155:0/1672325690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 msgr2=0x7f04a815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 --2- 172.21.15.155:0/1672325690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a815f0f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04a80caf10 tx=0x7f04a402a270 comp rx=0 tx=0).stop 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 -- 172.21.15.155:0/1672325690 shutdown_connections 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 --2- 172.21.15.155:0/1672325690 >> v2:172.21.15.191:3300/0 conn(0x7f04a80b5450 0x7f04a80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 --2- 172.21.15.155:0/1672325690 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b3c00 0x7f04a80b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 --2- 172.21.15.155:0/1672325690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a815f0f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 -- 172.21.15.155:0/1672325690 >> 172.21.15.155:0/1672325690 conn(0x7f04a8074d50 msgr2=0x7f04a8075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 -- 172.21.15.155:0/1672325690 shutdown_connections 2024-04-25T13:15:59.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.724+0000 7f04b0529640 1 -- 172.21.15.155:0/1672325690 wait complete. 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.725+0000 7f04b0529640 1 Processor -- start 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.725+0000 7f04b0529640 1 -- start start 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.725+0000 7f04b0529640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04a80b3c00 0x7f04a8154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04b0529640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b5450 0x7f04a81f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04b0529640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a81f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04b0529640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f04a80b4430 con 0x7f04a81554e0 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04b0529640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f04a80b4150 con 0x7f04a80b3c00 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04b0529640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f04a80b4710 con 0x7f04a80b5450 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a81f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a81f0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41684/0 (socket says 172.21.15.155:41684) 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 -- 172.21.15.155:0/2114438317 learned_addr learned my addr 172.21.15.155:0/2114438317 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04adac4640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b5450 0x7f04a81f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04ae2c5640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04a80b3c00 0x7f04a8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 -- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b5450 msgr2=0x7f04a81f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b5450 0x7f04a81f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 -- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04a80b3c00 msgr2=0x7f04a8154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04a80b3c00 0x7f04a8154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 -- 172.21.15.155:0/2114438317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a81f1ad0 con 0x7f04a81554e0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04aeac6640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a81f0b40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009dd0 tx=0x7f04a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0018020 con 0x7f04a81554e0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0014480 con 0x7f04a81554e0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0014870 con 0x7f04a81554e0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.726+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a81f17f0 con 0x7f04a81554e0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.727+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a815e280 con 0x7f04a81554e0 2024-04-25T13:15:59.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.727+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04a0005d10 con 0x7f04a81554e0 2024-04-25T13:15:59.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.727+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f04a0014da0 con 0x7f04a81554e0 2024-04-25T13:15:59.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.727+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a8068e40 con 0x7f04a81554e0 2024-04-25T13:15:59.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.730+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f04a0022070 con 0x7f04a81554e0 2024-04-25T13:15:59.776 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:15:59.776+0000 7fa76c579040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:15:59.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.790+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04a80cd8a0 con 0x7f04a81554e0 2024-04-25T13:15:59.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.791+0000 7f049effd640 1 -- 172.21.15.155:0/2114438317 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f04a0010040 con 0x7f04a81554e0 2024-04-25T13:15:59.791 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:15:59.791 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":10,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:15:59.542202+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 msgr2=0x7f04a81f0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a81f0b40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009dd0 tx=0x7f04a000c490 comp rx=0 tx=0).stop 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 shutdown_connections 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a81554e0 0x7f04a81f0b40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f04a80b5450 0x7f04a81f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 --2- 172.21.15.155:0/2114438317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04a80b3c00 0x7f04a8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 >> 172.21.15.155:0/2114438317 conn(0x7f04a8074d50 msgr2=0x7f04a8072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 shutdown_connections 2024-04-25T13:15:59.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:15:59.792+0000 7f04b0529640 1 -- 172.21.15.155:0/2114438317 wait complete. 2024-04-25T13:15:59.802 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T13:15:59.802 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T13:15:59.827 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:15:59.827+0000 7f9653921040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T13:16:00.038 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.038+0000 7fa76c579040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:16:00.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.085+0000 7f9653921040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:16:00.090 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.090+0000 7fa76c579040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:16:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.136+0000 7f9653921040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:16:00.167 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-04-25T13:16:00.167+0000 7f477f819640 -1 Falling back to public interface 2024-04-25T13:16:00.168 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:00.167+0000 7f6bc1e13640 -1 Falling back to public interface 2024-04-25T13:16:00.168 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:00.167+0000 7f6bc071d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T13:16:00.168 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:00.167+0000 7f6bc071d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T13:16:00.168 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:00.168+0000 7f6bc071d640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2024-04-25T13:16:00.171 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-25T13:16:00.171+0000 7fdd5265f640 -1 Falling back to public interface 2024-04-25T13:16:00.188 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-25T13:16:00.189+0000 7fb25661b640 -1 Falling back to public interface 2024-04-25T13:16:00.201 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-25T13:16:00.201+0000 7f5240514640 -1 Falling back to public interface 2024-04-25T13:16:00.201 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-25T13:16:00.201+0000 7f7b3b01a640 -1 Falling back to public interface 2024-04-25T13:16:00.202 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-25T13:16:00.201+0000 7f523f4c3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T13:16:00.202 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-25T13:16:00.201+0000 7f523f4c3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-25T13:16:00.205 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-25T13:16:00.205+0000 7f3bb2b4e640 -1 Falling back to public interface 2024-04-25T13:16:00.213 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.214+0000 7fa76c579040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:16:00.221 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-25T13:16:00.222+0000 7f074b101640 -1 Falling back to public interface 2024-04-25T13:16:00.257 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.257+0000 7f9653921040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T13:16:00.494 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.494+0000 7fa76c579040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:16:00.535 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.535+0000 7f9653921040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:16:00.541 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.542+0000 7fa76c579040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:16:00.582 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.582+0000 7f9653921040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:16:00.607 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:00.698 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.698+0000 7ff42ade8640 1 Processor -- start 2024-04-25T13:16:00.698 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.698+0000 7ff42ade8640 1 -- start start 2024-04-25T13:16:00.700 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.699+0000 7ff42ade8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c8a70 0x7ff4241648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.699+0000 7ff42ade8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff424159e10 con 0x7ff4240c9480 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.699+0000 7ff42ade8640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff424158f60 con 0x7ff4240c5810 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.699+0000 7ff42ade8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff424159270 con 0x7ff4240c8a70 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff428b84640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff4240c9480 0x7ff424159700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55300/0 (socket says 172.21.15.155:55300) 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff428b84640 1 -- 172.21.15.155:0/968668530 learned_addr learned my addr 172.21.15.155:0/968668530 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff429385640 1 --2- 172.21.15.155:0/968668530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c8a70 0x7ff4241648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 300778116 0 0) 0x7ff424159e10 con 0x7ff4240c9480 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff414003520 con 0x7ff4240c9480 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504267484 0 0) 0x7ff410001110 con 0x7ff4240c5810 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff424159e10 con 0x7ff4240c5810 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff429385640 1 -- 172.21.15.155:0/968668530 >> v1:172.21.15.191:6789/0 conn(0x7ff4240c5810 legacy=0x7ff424141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:00.701 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff429385640 1 -- 172.21.15.155:0/968668530 >> v1:172.21.15.155:6789/0 conn(0x7ff4240c9480 legacy=0x7ff424159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:00.702 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.700+0000 7ff429385640 1 -- 172.21.15.155:0/968668530 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4240c6050 con 0x7ff4240c8a70 2024-04-25T13:16:00.702 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.701+0000 7ff429385640 1 --2- 172.21.15.155:0/968668530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c8a70 0x7ff4241648f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009dc0 tx=0x7ff41c02a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28c41e5c247375b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:00.702 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.701+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c007740 con 0x7ff4240c8a70 2024-04-25T13:16:00.702 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.701+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41c0078e0 con 0x7ff4240c8a70 2024-04-25T13:16:00.702 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.701+0000 7ff4237fe640 1 -- 172.21.15.155:0/968668530 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c007cb0 con 0x7ff4240c8a70 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 -- 172.21.15.155:0/968668530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c8a70 msgr2=0x7ff4241648f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 --2- 172.21.15.155:0/968668530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c8a70 0x7ff4241648f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff41c009dc0 tx=0x7ff41c02a760 comp rx=0 tx=0).stop 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 -- 172.21.15.155:0/968668530 shutdown_connections 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 --2- 172.21.15.155:0/968668530 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c8a70 0x7ff4241648f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 -- 172.21.15.155:0/968668530 >> 172.21.15.155:0/968668530 conn(0x7ff42406f000 msgr2=0x7ff42406f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 -- 172.21.15.155:0/968668530 shutdown_connections 2024-04-25T13:16:00.703 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.702+0000 7ff42ade8640 1 -- 172.21.15.155:0/968668530 wait complete. 2024-04-25T13:16:00.704 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.704+0000 7ff42ade8640 1 Processor -- start 2024-04-25T13:16:00.704 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.704+0000 7ff42ade8640 1 -- start start 2024-04-25T13:16:00.705 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff42ade8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 0x7ff424152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:00.705 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff42ade8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4240c8a70 0x7ff424140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff42ade8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c9480 0x7ff424140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff42ade8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff4240c68d0 con 0x7ff4240c5810 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff42ade8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff4240c65f0 con 0x7ff4240c8a70 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff42ade8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff4240c5d10 con 0x7ff4240c9480 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 0x7ff424152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 0x7ff424152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:41698/0 (socket says 172.21.15.155:41698) 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 -- 172.21.15.155:0/332400379 learned_addr learned my addr 172.21.15.155:0/332400379 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff429385640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c9480 0x7ff424140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:00.706 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff423fff640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4240c8a70 0x7ff424140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:00.706 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.705+0000 7fa76c579040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 -- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c9480 msgr2=0x7ff424140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c9480 0x7ff424140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 -- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4240c8a70 msgr2=0x7ff424140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4240c8a70 0x7ff424140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.705+0000 7ff428b84640 1 -- 172.21.15.155:0/332400379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4241f2e70 con 0x7ff4240c5810 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff428b84640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 0x7ff424152840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c440 tx=0x7ff41800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418017070 con 0x7ff4240c5810 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff418005ce0 con 0x7ff4240c5810 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4241f3130 con 0x7ff4240c5810 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418007270 con 0x7ff4240c5810 2024-04-25T13:16:00.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42413b400 con 0x7ff4240c5810 2024-04-25T13:16:00.709 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff41801a070 con 0x7ff4240c5810 2024-04-25T13:16:00.709 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.706+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff41801cca0 con 0x7ff4240c5810 2024-04-25T13:16:00.709 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.707+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff424156860 con 0x7ff4240c5810 2024-04-25T13:16:00.709 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.709+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff418007410 con 0x7ff4240c5810 2024-04-25T13:16:00.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.739+0000 7f9653921040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:16:00.771 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.771+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff424073710 con 0x7ff4240c5810 2024-04-25T13:16:00.771 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.772+0000 7ff4217fa640 1 -- 172.21.15.155:0/332400379 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff4180075f0 con 0x7ff4240c5810 2024-04-25T13:16:00.771 INFO:teuthology.misc.health.smithi155.stdout: 2024-04-25T13:16:00.772 INFO:teuthology.misc.health.smithi155.stdout:{"epoch":10,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:15:59.542202+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:00.772 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.772+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 msgr2=0x7ff424152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.772+0000 7ff42ade8640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 0x7ff424152840 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c440 tx=0x7ff41800c900 comp rx=0 tx=0).stop 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.772+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 shutdown_connections 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.772+0000 7ff42ade8640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff4240c9480 0x7ff424140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.772+0000 7ff42ade8640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff4240c8a70 0x7ff424140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.773+0000 7ff42ade8640 1 --2- 172.21.15.155:0/332400379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4240c5810 0x7ff424152840 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.773+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 >> 172.21.15.155:0/332400379 conn(0x7ff42406f000 msgr2=0x7ff424158720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.773+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 shutdown_connections 2024-04-25T13:16:00.773 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:00.773+0000 7ff42ade8640 1 -- 172.21.15.155:0/332400379 wait complete. 2024-04-25T13:16:00.782 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:16:00.845 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.846+0000 7fa76c579040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:16:00.874 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.874+0000 7f9653921040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:16:00.894 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.895+0000 7fa76c579040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:16:00.923 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.923+0000 7f9653921040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:16:00.963 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:00.963+0000 7fa76c579040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:16:00.991 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:00.991+0000 7f9653921040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:16:01.010 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:01.010+0000 7fa76c579040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:16:01.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:01.038+0000 7f9653921040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:16:01.487 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:01.487+0000 7fa76c579040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:16:01.512 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:01.512+0000 7f9653921040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:16:01.605 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:01.606+0000 7fa76c579040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:16:01.631 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-25T13:16:01.631+0000 7f9653921040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:16:02.620 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:02.620+0000 7fa70d973640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T13:16:02.620 INFO:tasks.ceph.mgr.y.smithi155.stderr:2024-04-25T13:16:02.620+0000 7fa70d973640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T13:16:03.676 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-04-25T13:16:03.676+0000 7f477f819640 -1 osd.0 0 log_to_monitors true 2024-04-25T13:16:03.684 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-25T13:16:03.684+0000 7f5240514640 -1 osd.4 0 log_to_monitors true 2024-04-25T13:16:03.687 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:03.687+0000 7f6bc1e13640 -1 osd.3 0 log_to_monitors true 2024-04-25T13:16:03.692 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-25T13:16:03.692+0000 7fdd5265f640 -1 osd.1 0 log_to_monitors true 2024-04-25T13:16:03.695 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-25T13:16:03.696+0000 7fb25661b640 -1 osd.2 0 log_to_monitors true 2024-04-25T13:16:03.709 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-25T13:16:03.709+0000 7f3bb2b4e640 -1 osd.7 0 log_to_monitors true 2024-04-25T13:16:03.720 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-25T13:16:03.720+0000 7f7b3b01a640 -1 osd.5 0 log_to_monitors true 2024-04-25T13:16:03.726 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-25T13:16:03.726+0000 7f074b101640 -1 osd.6 0 log_to_monitors true 2024-04-25T13:16:07.589 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:07.606 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-25T13:16:07.606+0000 7fb251f2c640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T13:16:07.626 INFO:tasks.ceph.osd.2.smithi155.stderr:2024-04-25T13:16:07.626+0000 7fb249d4c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.654 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-25T13:16:07.654+0000 7f7b369e7640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T13:16:07.670 INFO:tasks.ceph.osd.5.smithi191.stderr:2024-04-25T13:16:07.670+0000 7f7b2e807640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.702 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-04-25T13:16:07.702+0000 7f477b207640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T13:16:07.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.708+0000 7f4f84aae640 1 Processor -- start 2024-04-25T13:16:07.708 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.709+0000 7f4f84aae640 1 -- start start 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f84aae640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4f801554d0 0x7f4f800cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f84aae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f800cb980 0x7f4f8006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f84aae640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f8015e7d0 con 0x7f4f8006d770 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f84aae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4f8015eab0 con 0x7f4f800cb980 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f84aae640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4f8015ed90 con 0x7f4f801554d0 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f800cb980 0x7f4f8006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f800cb980 0x7f4f8006d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49936/0 (socket says 172.21.15.155:49936) 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 -- 172.21.15.155:0/395631642 learned_addr learned my addr 172.21.15.155:0/395631642 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f7e59c640 1 --2- 172.21.15.155:0/395631642 >> v2:172.21.15.191:3300/0 conn(0x7f4f801554d0 0x7f4f800cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.711 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 -- 172.21.15.155:0/395631642 >> v2:172.21.15.191:3300/0 conn(0x7f4f801554d0 msgr2=0x7f4f800cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:07.712 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 --2- 172.21.15.155:0/395631642 >> v2:172.21.15.191:3300/0 conn(0x7f4f801554d0 0x7f4f800cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.712 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 -- 172.21.15.155:0/395631642 >> v1:172.21.15.191:6789/0 conn(0x7f4f8006d770 legacy=0x7f4f8015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.712 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.710+0000 7f4f77fff640 1 -- 172.21.15.155:0/395631642 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8015f070 con 0x7f4f800cb980 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.711+0000 7f4f77fff640 1 --2- 172.21.15.155:0/395631642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f8006d230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f800cb910 tx=0x7f4f6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a6b0e0b6b5b3c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.712+0000 7f4f7dd9b640 1 -- 172.21.15.155:0/395631642 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68037070 con 0x7f4f800cb980 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.712+0000 7f4f7dd9b640 1 -- 172.21.15.155:0/395631642 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f68032440 con 0x7f4f800cb980 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.712+0000 7f4f7dd9b640 1 -- 172.21.15.155:0/395631642 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68032810 con 0x7f4f800cb980 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 -- 172.21.15.155:0/395631642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 msgr2=0x7f4f8006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 --2- 172.21.15.155:0/395631642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f8006d230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f800cb910 tx=0x7f4f6802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 -- 172.21.15.155:0/395631642 shutdown_connections 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 --2- 172.21.15.155:0/395631642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f8006d230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 --2- 172.21.15.155:0/395631642 >> v2:172.21.15.191:3300/0 conn(0x7f4f801554d0 0x7f4f800cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 -- 172.21.15.155:0/395631642 >> 172.21.15.155:0/395631642 conn(0x7f4f800cd6d0 msgr2=0x7f4f800cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:07.713 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 -- 172.21.15.155:0/395631642 shutdown_connections 2024-04-25T13:16:07.714 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.713+0000 7f4f84aae640 1 -- 172.21.15.155:0/395631642 wait complete. 2024-04-25T13:16:07.714 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.714+0000 7f4f84aae640 1 Processor -- start 2024-04-25T13:16:07.714 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.714+0000 7f4f84aae640 1 -- start start 2024-04-25T13:16:07.714 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f84aae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f8006d770 0x7f4f8015e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.715 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f84aae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f801f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.715 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f84aae640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f801554d0 0x7f4f8014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.715 INFO:tasks.ceph.osd.0.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4773027640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.717 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f801f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.717 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f801f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:49942/0 (socket says 172.21.15.155:49942) 2024-04-25T13:16:07.717 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 -- 172.21.15.155:0/1220532468 learned_addr learned my addr 172.21.15.155:0/1220532468 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:07.717 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f84aae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800cd230 con 0x7f4f800cb980 2024-04-25T13:16:07.717 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f7e59c640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f8006d770 0x7f4f8015e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.718 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800b3b30 con 0x7f4f8006d770 2024-04-25T13:16:07.718 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8015bba0 con 0x7f4f801554d0 2024-04-25T13:16:07.718 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f7ed9d640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f801554d0 0x7f4f8014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.718 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 -- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f801554d0 msgr2=0x7f4f8014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.718 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f801554d0 0x7f4f8014ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.719 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 -- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f8006d770 msgr2=0x7f4f8015e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.719 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f8006d770 0x7f4f8015e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.719 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f77fff640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f800b6d70 con 0x7f4f800cb980 2024-04-25T13:16:07.719 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f7ed9d640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f801554d0 0x7f4f8014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:07.719 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.715+0000 7f4f7e59c640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f8006d770 0x7f4f8015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:07.720 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.716+0000 7f4f77fff640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f801f4c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f6802a2b0 tx=0x7f4f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.720 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.716+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68041070 con 0x7f4f800cb980 2024-04-25T13:16:07.720 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.716+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6803c870 con 0x7f4f800cb980 2024-04-25T13:16:07.720 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.716+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68037040 con 0x7f4f800cb980 2024-04-25T13:16:07.720 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.716+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f800b60b0 con 0x7f4f800cb980 2024-04-25T13:16:07.720 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.716+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f800b6670 con 0x7f4f800cb980 2024-04-25T13:16:07.721 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.718+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f4f68044070 con 0x7f4f800cb980 2024-04-25T13:16:07.721 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.718+0000 7f4f76ffd640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f6406c860 0x7f4f6406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:07.721 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.718+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f4f680ab660 con 0x7f4f800cb980 2024-04-25T13:16:07.721 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.718+0000 7f4f7e59c640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f6406c860 0x7f4f6406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:07.721 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.718+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f8006e2f0 con 0x7f4f800cb980 2024-04-25T13:16:07.722 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.719+0000 7f4f7e59c640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f6406c860 0x7f4f6406ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009e90 tx=0x7f4f70009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:07.723 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.724+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f6807a340 con 0x7f4f800cb980 2024-04-25T13:16:07.733 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-25T13:16:07.732+0000 7f3baeae4640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T13:16:07.750 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-25T13:16:07.750+0000 7f0747097640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T13:16:07.752 INFO:tasks.ceph.osd.7.smithi191.stderr:2024-04-25T13:16:07.752+0000 7f3ba6904640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.755 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-25T13:16:07.755+0000 7f523c4aa640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T13:16:07.765 INFO:tasks.ceph.osd.4.smithi191.stderr:2024-04-25T13:16:07.765+0000 7f52342ca640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.765 INFO:tasks.ceph.osd.6.smithi191.stderr:2024-04-25T13:16:07.765+0000 7f073eeb7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.765 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-25T13:16:07.766+0000 7fdd4e5f5640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T13:16:07.774 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:07.774+0000 7f6bbd704640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T13:16:07.776 INFO:tasks.ceph.osd.1.smithi155.stderr:2024-04-25T13:16:07.777+0000 7fdd46415640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.783 INFO:tasks.ceph.osd.3.smithi155.stderr:2024-04-25T13:16:07.784+0000 7f6bb5524640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:16:07.915 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.915+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f8004fdc0 con 0x7f4f800cb980 2024-04-25T13:16:07.915 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.915+0000 7f4f76ffd640 1 -- 172.21.15.155:0/1220532468 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f4f6807e640 con 0x7f4f800cb980 2024-04-25T13:16:07.915 INFO:teuthology.misc.health.smithi155.stdout: 2024-04-25T13:16:07.915 INFO:teuthology.misc.health.smithi155.stdout:{"epoch":12,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:05.624883+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:07.917 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f6406c860 msgr2=0x7f4f6406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.917 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f6406c860 0x7f4f6406ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009e90 tx=0x7f4f70009190 comp rx=0 tx=0).stop 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 msgr2=0x7f4f801f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f801f4c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f6802a2b0 tx=0x7f4f680046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 shutdown_connections 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f6406c860 0x7f4f6406ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f801554d0 0x7f4f8014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cb980 0x7f4f801f4c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 --2- 172.21.15.155:0/1220532468 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f8006d770 0x7f4f8015e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 >> 172.21.15.155:0/1220532468 conn(0x7f4f800cd6d0 msgr2=0x7f4f80152230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 shutdown_connections 2024-04-25T13:16:07.918 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:07.917+0000 7f4f84aae640 1 -- 172.21.15.155:0/1220532468 wait complete. 2024-04-25T13:16:07.927 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:16:11.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:11.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:14.734 DEBUG:teuthology.orchestra.run.smithi155:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:14.835 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.835+0000 7f4e7558e640 1 Processor -- start 2024-04-25T13:16:14.835 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.835+0000 7f4e7558e640 1 -- start start 2024-04-25T13:16:14.836 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e7558e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4e700cb980 0x7f4e7006d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e7558e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7015e7d0 con 0x7f4e701554d0 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e7558e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7015eab0 con 0x7f4e7006d770 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e7558e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7015ed90 con 0x7f4e700cb980 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e6effd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4e701554d0 0x7f4e700cccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57640/0 (socket says 172.21.15.155:57640) 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e6effd640 1 -- 172.21.15.155:0/1697013802 learned_addr learned my addr 172.21.15.155:0/1697013802 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e6e7fc640 1 --2- 172.21.15.155:0/1697013802 >> v2:172.21.15.191:3300/0 conn(0x7f4e700cb980 0x7f4e7006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045863403 0 0) 0x7f4e7015e7d0 con 0x7f4e701554d0 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e58003520 con 0x7f4e701554d0 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.836+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671973455 0 0) 0x7f4e7015eab0 con 0x7f4e7006d770 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.837+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7015e7d0 con 0x7f4e7006d770 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.837+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4059027155 0 0) 0x7f4e58003520 con 0x7f4e701554d0 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.837+0000 7f4e6e7fc640 1 -- 172.21.15.155:0/1697013802 >> v1:172.21.15.191:6789/0 conn(0x7f4e7006d770 legacy=0x7f4e7015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.837 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.837+0000 7f4e6e7fc640 1 -- 172.21.15.155:0/1697013802 >> v1:172.21.15.155:6789/0 conn(0x7f4e701554d0 legacy=0x7f4e700cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.838 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.837+0000 7f4e6e7fc640 1 -- 172.21.15.155:0/1697013802 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7015f070 con 0x7f4e700cb980 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.837+0000 7f4e6e7fc640 1 --2- 172.21.15.155:0/1697013802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7006d230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e640097a0 tx=0x7f4e6402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9ad5cb5e2c652d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64037070 con 0x7f4e700cb980 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6402ac50 con 0x7f4e700cb980 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e6dffb640 1 -- 172.21.15.155:0/1697013802 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600019f0 con 0x7f4e700cb980 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 -- 172.21.15.155:0/1697013802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 msgr2=0x7f4e7006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 --2- 172.21.15.155:0/1697013802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7006d230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e640097a0 tx=0x7f4e6402a1c0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 -- 172.21.15.155:0/1697013802 shutdown_connections 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 --2- 172.21.15.155:0/1697013802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7006d230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 -- 172.21.15.155:0/1697013802 >> 172.21.15.155:0/1697013802 conn(0x7f4e700cd6d0 msgr2=0x7f4e700cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 -- 172.21.15.155:0/1697013802 shutdown_connections 2024-04-25T13:16:14.839 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.838+0000 7f4e7558e640 1 -- 172.21.15.155:0/1697013802 wait complete. 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.839+0000 7f4e7558e640 1 Processor -- start 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.839+0000 7f4e7558e640 1 -- start start 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e7558e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 0x7f4e701e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e7558e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e7558e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e701554d0 0x7f4e7015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e7558e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7015bba0 con 0x7f4e7006d770 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e7558e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700b3b30 con 0x7f4e700cb980 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e7558e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7015bd20 con 0x7f4e701554d0 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e6effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 0x7f4e701e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.842 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e6effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 0x7f4e701e5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54526/0 (socket says 172.21.15.155:54526) 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.840+0000 7f4e6effd640 1 -- 172.21.15.155:0/2782169199 learned_addr learned my addr 172.21.15.155:0/2782169199 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6e7fc640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6f7fe640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e701554d0 0x7f4e7015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6effd640 1 -- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e701554d0 msgr2=0x7f4e7015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6effd640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e701554d0 0x7f4e7015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6effd640 1 -- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 msgr2=0x7f4e7015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6effd640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6effd640 1 -- 172.21.15.155:0/2782169199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e701e5e90 con 0x7f4e7006d770 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6e7fc640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6f7fe640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e701554d0 0x7f4e7015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e6effd640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 0x7f4e701e5950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e60001f90 tx=0x7f4e6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60017070 con 0x7f4e7006d770 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60012400 con 0x7f4e7006d770 2024-04-25T13:16:14.843 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e701e4570 con 0x7f4e7006d770 2024-04-25T13:16:14.844 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600127f0 con 0x7f4e7006d770 2024-04-25T13:16:14.844 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.841+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e701e5150 con 0x7f4e7006d770 2024-04-25T13:16:14.844 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.842+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7014f550 con 0x7f4e7006d770 2024-04-25T13:16:14.844 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.843+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e6001a070 con 0x7f4e7006d770 2024-04-25T13:16:14.845 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.843+0000 7f4e577fe640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4e5c06c8f0 0x7f4e5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:14.845 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.843+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4e6008b810 con 0x7f4e7006d770 2024-04-25T13:16:14.845 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.843+0000 7f4e6e7fc640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4e5c06c8f0 0x7f4e5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:14.845 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.843+0000 7f4e6e7fc640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4e5c06c8f0 0x7f4e5c06edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e64034000 tx=0x7f4e6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:14.847 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:14.848+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e6005a050 con 0x7f4e7006d770 2024-04-25T13:16:15.027 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.027+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e7006e2f0 con 0x7f4e7006d770 2024-04-25T13:16:15.028 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.028+0000 7f4e577fe640 1 -- 172.21.15.155:0/2782169199 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12944 (secure 0 0 0) 0x7f4e60059950 con 0x7f4e7006d770 2024-04-25T13:16:15.028 INFO:teuthology.misc.health.smithi155.stdout: 2024-04-25T13:16:15.028 INFO:teuthology.misc.health.smithi155.stdout:{"epoch":17,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:12.618663+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4e5c06c8f0 msgr2=0x7f4e5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4e5c06c8f0 0x7f4e5c06edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e64034000 tx=0x7f4e6402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 msgr2=0x7f4e701e5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 0x7f4e701e5950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e60001f90 tx=0x7f4e6000a430 comp rx=0 tx=0).stop 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 shutdown_connections 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4e5c06c8f0 0x7f4e5c06edb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4e701554d0 0x7f4e7015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4e700cb980 0x7f4e7015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 --2- 172.21.15.155:0/2782169199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e7006d770 0x7f4e701e5950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 >> 172.21.15.155:0/2782169199 conn(0x7f4e700cd6d0 msgr2=0x7f4e7014b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 shutdown_connections 2024-04-25T13:16:15.031 INFO:teuthology.misc.health.smithi155.stderr:2024-04-25T13:16:15.030+0000 7f4e7558e640 1 -- 172.21.15.155:0/2782169199 wait complete. 2024-04-25T13:16:15.040 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T13:16:15.040 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T13:16:15.040 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T13:16:15.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T13:16:15.043 INFO:tasks.ceph.mds.a:Started 2024-04-25T13:16:15.043 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T13:16:15.043 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T13:16:15.045 INFO:tasks.ceph.mds.c:Started 2024-04-25T13:16:15.045 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T13:16:15.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T13:16:15.047 INFO:tasks.ceph.mds.e:Started 2024-04-25T13:16:15.047 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T13:16:15.047 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T13:16:15.050 INFO:tasks.ceph.mds.b:Started 2024-04-25T13:16:15.050 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T13:16:15.050 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T13:16:15.053 INFO:tasks.ceph.mds.d:Started 2024-04-25T13:16:15.053 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T13:16:15.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T13:16:15.055 INFO:tasks.ceph.mds.f:Started 2024-04-25T13:16:15.055 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T13:16:15.055 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:15.117 INFO:tasks.ceph.mds.a.smithi155.stdout:starting mds.a at 2024-04-25T13:16:15.118 INFO:tasks.ceph.mds.c.smithi155.stdout:starting mds.c at 2024-04-25T13:16:15.120 INFO:tasks.ceph.mds.e.smithi155.stdout:starting mds.e at 2024-04-25T13:16:15.135 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2024-04-25T13:16:15.136 INFO:tasks.ceph.mds.f.smithi191.stdout:starting mds.f at 2024-04-25T13:16:15.136 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2024-04-25T13:16:15.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.160+0000 7faffc4a7640 1 Processor -- start 2024-04-25T13:16:15.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.160+0000 7faffc4a7640 1 -- start start 2024-04-25T13:16:15.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faffc4a7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faff40c8870 0x7faff415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faffc4a7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faff415ca00 0x7faff4073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faffc4a7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff4158fe0 con 0x7faff4152f70 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faffc4a7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faff41592c0 con 0x7faff40c8870 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faffc4a7640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faff41595a0 con 0x7faff415ca00 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faff9a42640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faff40c8870 0x7faff415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faff9a42640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faff40c8870 0x7faff415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54574/0 (socket says 172.21.15.155:54574) 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.161+0000 7faff9a42640 1 -- 172.21.15.155:0/785750036 learned_addr learned my addr 172.21.15.155:0/785750036 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faffaa44640 1 --2- 172.21.15.155:0/785750036 >> v2:172.21.15.191:3300/0 conn(0x7faff415ca00 0x7faff4073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faff9a42640 1 -- 172.21.15.155:0/785750036 >> v2:172.21.15.191:3300/0 conn(0x7faff415ca00 msgr2=0x7faff4073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faff9a42640 1 --2- 172.21.15.155:0/785750036 >> v2:172.21.15.191:3300/0 conn(0x7faff415ca00 0x7faff4073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faff9a42640 1 -- 172.21.15.155:0/785750036 >> v1:172.21.15.155:6789/0 conn(0x7faff4152f70 legacy=0x7faff40c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faff9a42640 1 -- 172.21.15.155:0/785750036 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff4159880 con 0x7faff40c8870 2024-04-25T13:16:15.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faffaa44640 1 --2- 172.21.15.155:0/785750036 >> v2:172.21.15.191:3300/0 conn(0x7faff415ca00 0x7faff4073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.162+0000 7faff9a42640 1 --2- 172.21.15.155:0/785750036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff415c4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faff4071d20 tx=0x7fafe402e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710f52df05d7cdad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faff9241640 1 -- 172.21.15.155:0/785750036 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe403a070 con 0x7faff40c8870 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faff9241640 1 -- 172.21.15.155:0/785750036 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe400b650 con 0x7faff40c8870 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faff9241640 1 -- 172.21.15.155:0/785750036 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe400ba20 con 0x7faff40c8870 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 -- 172.21.15.155:0/785750036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 msgr2=0x7faff415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 --2- 172.21.15.155:0/785750036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff415c4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faff4071d20 tx=0x7fafe402e570 comp rx=0 tx=0).stop 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 -- 172.21.15.155:0/785750036 shutdown_connections 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 --2- 172.21.15.155:0/785750036 >> v2:172.21.15.191:3300/0 conn(0x7faff415ca00 0x7faff4073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 --2- 172.21.15.155:0/785750036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff415c4c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 -- 172.21.15.155:0/785750036 >> 172.21.15.155:0/785750036 conn(0x7faff4074d50 msgr2=0x7faff4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 -- 172.21.15.155:0/785750036 shutdown_connections 2024-04-25T13:16:15.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.163+0000 7faffc4a7640 1 -- 172.21.15.155:0/785750036 wait complete. 2024-04-25T13:16:15.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.164+0000 7faffc4a7640 1 Processor -- start 2024-04-25T13:16:15.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.164+0000 7faffc4a7640 1 -- start start 2024-04-25T13:16:15.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffc4a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff40cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffc4a7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4152f70 0x7faff41ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffc4a7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff415ca00 0x7faff40c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffc4a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faff4153350 con 0x7faff40c8870 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffc4a7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faff415ce20 con 0x7faff415ca00 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffc4a7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faff41534d0 con 0x7faff4152f70 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff40cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff40cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54576/0 (socket says 172.21.15.155:54576) 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 -- 172.21.15.155:0/678800380 learned_addr learned my addr 172.21.15.155:0/678800380 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffaa44640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff415ca00 0x7faff40c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faff9a42640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4152f70 0x7faff41ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 -- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4152f70 msgr2=0x7faff41ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4152f70 0x7faff41ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 -- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff415ca00 msgr2=0x7faff40c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff415ca00 0x7faff40c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faffa243640 1 -- 172.21.15.155:0/678800380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff406c970 con 0x7faff40c8870 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.165+0000 7faff9a42640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4152f70 0x7faff41ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.166+0000 7faffa243640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff40cd6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faff000c450 tx=0x7faff000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.166+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff00052d0 con 0x7faff40c8870 2024-04-25T13:16:15.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.166+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0005470 con 0x7faff40c8870 2024-04-25T13:16:15.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.166+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff406cc10 con 0x7faff40c8870 2024-04-25T13:16:15.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.166+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0012870 con 0x7faff40c8870 2024-04-25T13:16:15.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.166+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff406d1b0 con 0x7faff40c8870 2024-04-25T13:16:15.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.167+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff4068e40 con 0x7faff40c8870 2024-04-25T13:16:15.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.167+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faff0012a10 con 0x7faff40c8870 2024-04-25T13:16:15.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.168+0000 7fafeaffd640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fafd806c8f0 0x7fafd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.168+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faff008b400 con 0x7faff40c8870 2024-04-25T13:16:15.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.168+0000 7faff9a42640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fafd806c8f0 0x7fafd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.169+0000 7faff9a42640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fafd806c8f0 0x7fafd806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fafe4037000 tx=0x7fafe400d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.172+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faff0059b80 con 0x7faff40c8870 2024-04-25T13:16:15.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.348+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faff4152140 con 0x7faff40c8870 2024-04-25T13:16:15.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.349+0000 7fafeaffd640 1 -- 172.21.15.155:0/678800380 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12944 (secure 0 0 0) 0x7faff0059480 con 0x7faff40c8870 2024-04-25T13:16:15.349 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:15.349 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":17,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:12.618663+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:15.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fafd806c8f0 msgr2=0x7fafd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fafd806c8f0 0x7fafd806edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fafe4037000 tx=0x7fafe400d000 comp rx=0 tx=0).stop 2024-04-25T13:16:15.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 msgr2=0x7faff40cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff40cd6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faff000c450 tx=0x7faff000c910 comp rx=0 tx=0).stop 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 shutdown_connections 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faff415ca00 0x7faff40c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fafd806c8f0 0x7fafd806edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faff4152f70 0x7faff41ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 --2- 172.21.15.155:0/678800380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faff40c8870 0x7faff40cd6d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 >> 172.21.15.155:0/678800380 conn(0x7faff4074d50 msgr2=0x7faff414ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 shutdown_connections 2024-04-25T13:16:15.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.351+0000 7faffc4a7640 1 -- 172.21.15.155:0/678800380 wait complete. 2024-04-25T13:16:15.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:16:15.362 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:15.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.463+0000 7f86e2120640 1 Processor -- start 2024-04-25T13:16:15.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.463+0000 7f86e2120640 1 -- start start 2024-04-25T13:16:15.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.463+0000 7f86e2120640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc154f00 0x7f86dc073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.463+0000 7f86e2120640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86dc0b3600 0x7f86dc073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.463+0000 7f86e2120640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86dc15be60 con 0x7f86dc0cdda0 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86e2120640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f86dc15e650 con 0x7f86dc0b3600 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86e2120640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f86dc15e930 con 0x7f86dc154f00 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86dc0b3600 0x7f86dc073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86dc0b3600 0x7f86dc073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54588/0 (socket says 172.21.15.155:54588) 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 -- 172.21.15.155:0/3409742119 learned_addr learned my addr 172.21.15.155:0/3409742119 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86db7fe640 1 --2- 172.21.15.155:0/3409742119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc154f00 0x7f86dc073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 -- 172.21.15.155:0/3409742119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc154f00 msgr2=0x7f86dc073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 --2- 172.21.15.155:0/3409742119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc154f00 0x7f86dc073110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 -- 172.21.15.155:0/3409742119 >> v1:172.21.15.191:6789/0 conn(0x7f86dc0cdda0 legacy=0x7f86dc0cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.464+0000 7f86daffd640 1 -- 172.21.15.155:0/3409742119 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc15ec10 con 0x7f86dc0b3600 2024-04-25T13:16:15.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86daffd640 1 --2- 172.21.15.155:0/3409742119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc0b3600 0x7f86dc073650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009870 tx=0x7f86d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e8c06ac5c199a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86da7fc640 1 -- 172.21.15.155:0/3409742119 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0037070 con 0x7f86dc0b3600 2024-04-25T13:16:15.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86da7fc640 1 -- 172.21.15.155:0/3409742119 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d0032440 con 0x7f86dc0b3600 2024-04-25T13:16:15.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86da7fc640 1 -- 172.21.15.155:0/3409742119 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0032810 con 0x7f86dc0b3600 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 -- 172.21.15.155:0/3409742119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc0b3600 msgr2=0x7f86dc073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 --2- 172.21.15.155:0/3409742119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc0b3600 0x7f86dc073650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009870 tx=0x7f86d002a270 comp rx=0 tx=0).stop 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 -- 172.21.15.155:0/3409742119 shutdown_connections 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 --2- 172.21.15.155:0/3409742119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc0b3600 0x7f86dc073650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 --2- 172.21.15.155:0/3409742119 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc154f00 0x7f86dc073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 -- 172.21.15.155:0/3409742119 >> 172.21.15.155:0/3409742119 conn(0x7f86dc068570 msgr2=0x7f86dc071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 -- 172.21.15.155:0/3409742119 shutdown_connections 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.465+0000 7f86e2120640 1 -- 172.21.15.155:0/3409742119 wait complete. 2024-04-25T13:16:15.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.466+0000 7f86e2120640 1 Processor -- start 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 -- start start 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc0b3600 0x7f86dc149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86dc0cdda0 0x7f86dc15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 0x7f86dc1473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc1552e0 con 0x7f86dc154f00 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc0cb230 con 0x7f86dc0cdda0 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86e2120640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f86dc1499b0 con 0x7f86dc0b3600 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 0x7f86dc1473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 0x7f86dc1473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54598/0 (socket says 172.21.15.155:54598) 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.467+0000 7f86dbfff640 1 -- 172.21.15.155:0/203775790 learned_addr learned my addr 172.21.15.155:0/203775790 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86daffd640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86dc0cdda0 0x7f86dc15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86db7fe640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc0b3600 0x7f86dc149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86dbfff640 1 -- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc0b3600 msgr2=0x7f86dc149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86dbfff640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc0b3600 0x7f86dc149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86dbfff640 1 -- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86dc0cdda0 msgr2=0x7f86dc15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86dbfff640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86dc0cdda0 0x7f86dc15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86dbfff640 1 -- 172.21.15.155:0/203775790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc149c70 con 0x7f86dc154f00 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86daffd640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86dc0cdda0 0x7f86dc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86dbfff640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 0x7f86dc1473e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c6b0 tx=0x7f86d400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4003b70 con 0x7f86dc154f00 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d4003d30 con 0x7f86dc154f00 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4005310 con 0x7f86dc154f00 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc149f30 con 0x7f86dc154f00 2024-04-25T13:16:15.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.468+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc159300 con 0x7f86dc154f00 2024-04-25T13:16:15.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.469+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc068f50 con 0x7f86dc154f00 2024-04-25T13:16:15.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.469+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86d40054b0 con 0x7f86dc154f00 2024-04-25T13:16:15.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.470+0000 7f86c3fff640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f86c806c8f0 0x7f86c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.470+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f86d408b690 con 0x7f86dc154f00 2024-04-25T13:16:15.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.470+0000 7f86db7fe640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f86c806c8f0 0x7f86c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.470+0000 7f86db7fe640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f86c806c8f0 0x7f86c806edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86cc006fd0 tx=0x7f86cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.474 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.474+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f86d4059e10 con 0x7f86dc154f00 2024-04-25T13:16:15.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.651+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86dc14ed30 con 0x7f86dc154f00 2024-04-25T13:16:15.651 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.652+0000 7f86c3fff640 1 -- 172.21.15.155:0/203775790 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f86d4059710 con 0x7f86dc154f00 2024-04-25T13:16:15.652 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f86c806c8f0 msgr2=0x7f86c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f86c806c8f0 0x7f86c806edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f86cc006fd0 tx=0x7f86cc008040 comp rx=0 tx=0).stop 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 msgr2=0x7f86dc1473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 0x7f86dc1473e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c6b0 tx=0x7f86d400cb70 comp rx=0 tx=0).stop 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 shutdown_connections 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86dc154f00 0x7f86dc1473e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f86dc0cdda0 0x7f86dc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.654 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f86c806c8f0 0x7f86c806edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 --2- 172.21.15.155:0/203775790 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f86dc0b3600 0x7f86dc149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 >> 172.21.15.155:0/203775790 conn(0x7f86dc068570 msgr2=0x7f86dc0c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 shutdown_connections 2024-04-25T13:16:15.655 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.654+0000 7f86e2120640 1 -- 172.21.15.155:0/203775790 wait complete. 2024-04-25T13:16:15.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:15.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.761+0000 7f88fc729640 1 Processor -- start 2024-04-25T13:16:15.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.761+0000 7f88fc729640 1 -- start start 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fc729640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f88f41553a0 0x7f88f415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fc729640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f88f40c9440 0x7f88f406d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fc729640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f40c8420 0x7f88f40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fc729640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f88f415c0a0 con 0x7f88f41553a0 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fc729640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f88f415efa0 con 0x7f88f40c9440 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fc729640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f88f40c7970 con 0x7f88f40c8420 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fa4c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f88f41553a0 0x7f88f415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fa4c5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f88f41553a0 0x7f88f415bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54602/0 (socket says 172.21.15.155:54602) 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.762+0000 7f88fa4c5640 1 -- 172.21.15.155:0/767553414 learned_addr learned my addr 172.21.15.155:0/767553414 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88f9cc4640 1 --2- 172.21.15.155:0/767553414 >> v2:172.21.15.191:3300/0 conn(0x7f88f40c9440 0x7f88f406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88facc6640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f40c8420 0x7f88f40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88fa4c5640 1 -- 172.21.15.155:0/767553414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f40c8420 msgr2=0x7f88f40c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88fa4c5640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f40c8420 0x7f88f40c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88fa4c5640 1 -- 172.21.15.155:0/767553414 >> v2:172.21.15.191:3300/0 conn(0x7f88f40c9440 msgr2=0x7f88f406d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:15.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88fa4c5640 1 --2- 172.21.15.155:0/767553414 >> v2:172.21.15.191:3300/0 conn(0x7f88f40c9440 0x7f88f406d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88fa4c5640 1 -- 172.21.15.155:0/767553414 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f40c9190 con 0x7f88f41553a0 2024-04-25T13:16:15.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88facc6640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f40c8420 0x7f88f40c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:15.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88fa4c5640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f41553a0 0x7f88f415bb60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88f40c99d0 tx=0x7f88f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35875d2fbe0c354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88f94c3640 1 -- 172.21.15.155:0/767553414 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0036070 con 0x7f88f41553a0 2024-04-25T13:16:15.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88f94c3640 1 -- 172.21.15.155:0/767553414 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0031600 con 0x7f88f41553a0 2024-04-25T13:16:15.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.763+0000 7f88f94c3640 1 -- 172.21.15.155:0/767553414 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f00319d0 con 0x7f88f41553a0 2024-04-25T13:16:15.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 -- 172.21.15.155:0/767553414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f41553a0 msgr2=0x7f88f415bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f41553a0 0x7f88f415bb60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88f40c99d0 tx=0x7f88f002a730 comp rx=0 tx=0).stop 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 -- 172.21.15.155:0/767553414 shutdown_connections 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f40c8420 0x7f88f40c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 --2- 172.21.15.155:0/767553414 >> v2:172.21.15.191:3300/0 conn(0x7f88f40c9440 0x7f88f406d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 --2- 172.21.15.155:0/767553414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f41553a0 0x7f88f415bb60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 -- 172.21.15.155:0/767553414 >> 172.21.15.155:0/767553414 conn(0x7f88f40c9a70 msgr2=0x7f88f40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 -- 172.21.15.155:0/767553414 shutdown_connections 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.764+0000 7f88fc729640 1 -- 172.21.15.155:0/767553414 wait complete. 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.765+0000 7f88fc729640 1 Processor -- start 2024-04-25T13:16:15.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.765+0000 7f88fc729640 1 -- start start 2024-04-25T13:16:15.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fc729640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f40c8420 0x7f88f40b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fc729640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 0x7f88f4071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fc729640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f41553a0 0x7f88f41f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fc729640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88f415e670 con 0x7f88f40c9440 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fc729640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f88f40c7f20 con 0x7f88f40c8420 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fc729640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f88f415e950 con 0x7f88f41553a0 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 0x7f88f4071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 0x7f88f4071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54606/0 (socket says 172.21.15.155:54606) 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 -- 172.21.15.155:0/1856496481 learned_addr learned my addr 172.21.15.155:0/1856496481 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88fa4c5640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f40c8420 0x7f88f40b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88facc6640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f41553a0 0x7f88f41f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 -- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f41553a0 msgr2=0x7f88f41f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f41553a0 0x7f88f41f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 -- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f40c8420 msgr2=0x7f88f40b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f40c8420 0x7f88f40b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.766+0000 7f88f9cc4640 1 -- 172.21.15.155:0/1856496481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f414f750 con 0x7f88f40c9440 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.767+0000 7f88f9cc4640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 0x7f88f4071d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d800 tx=0x7f88e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.767+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e400b6c0 con 0x7f88f40c9440 2024-04-25T13:16:15.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.767+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e4019070 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.767+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e400ba80 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.767+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f414fa10 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.767+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f41f0ae0 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.768+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f4068e40 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.768+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f88e400bc20 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.768+0000 7f88eaffd640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f88d806c8f0 0x7f88d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.769+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f88e408bab0 con 0x7f88f40c9440 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.769+0000 7f88fa4c5640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f88d806c8f0 0x7f88d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:15.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.769+0000 7f88fa4c5640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f88d806c8f0 0x7f88d806edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88f0033000 tx=0x7f88f0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:15.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.773+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f88e4059c70 con 0x7f88f40c9440 2024-04-25T13:16:15.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.982+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88f40c8200 con 0x7f88f40c9440 2024-04-25T13:16:15.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.983+0000 7f88eaffd640 1 -- 172.21.15.155:0/1856496481 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f88e405df70 con 0x7f88f40c9440 2024-04-25T13:16:15.983 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:16:15.983 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 2 2024-04-25T13:16:15.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f88d806c8f0 msgr2=0x7f88d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f88d806c8f0 0x7f88d806edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88f0033000 tx=0x7f88f0009000 comp rx=0 tx=0).stop 2024-04-25T13:16:15.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 msgr2=0x7f88f4071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:15.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 0x7f88f4071d90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f88e400d800 tx=0x7f88e400dcc0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 shutdown_connections 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f88d806c8f0 0x7f88d806edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f88f41553a0 0x7f88f41f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88f40c9440 0x7f88f4071d90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 --2- 172.21.15.155:0/1856496481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88f40c8420 0x7f88f40b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 >> 172.21.15.155:0/1856496481 conn(0x7f88f40c9a70 msgr2=0x7f88f40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 shutdown_connections 2024-04-25T13:16:15.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:15.985+0000 7f88fc729640 1 -- 172.21.15.155:0/1856496481 wait complete. 2024-04-25T13:16:17.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:18.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.105+0000 7f23eb54a640 1 Processor -- start 2024-04-25T13:16:18.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.105+0000 7f23eb54a640 1 -- start start 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23eb54a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f23e41554e0 0x7f23e415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23eb54a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23e40d08a0 0x7f23e40d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23eb54a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e41558c0 con 0x7f23e40b3c00 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23eb54a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f23e40b4a80 con 0x7f23e40d08a0 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23eb54a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f23e415f630 con 0x7f23e41554e0 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23e9ae7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23e40d08a0 0x7f23e40d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23e9ae7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23e40d08a0 0x7f23e40d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54608/0 (socket says 172.21.15.155:54608) 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23e9ae7640 1 -- 172.21.15.155:0/4032799695 learned_addr learned my addr 172.21.15.155:0/4032799695 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:18.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.106+0000 7f23e8ae5640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f23e40b3c00 0x7f23e40b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57692/0 (socket says 172.21.15.155:57692) 2024-04-25T13:16:18.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23e92e6640 1 --2- 172.21.15.155:0/4032799695 >> v2:172.21.15.191:3300/0 conn(0x7f23e41554e0 0x7f23e415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23e9ae7640 1 -- 172.21.15.155:0/4032799695 >> v2:172.21.15.191:3300/0 conn(0x7f23e41554e0 msgr2=0x7f23e415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23e9ae7640 1 --2- 172.21.15.155:0/4032799695 >> v2:172.21.15.191:3300/0 conn(0x7f23e41554e0 0x7f23e415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23e9ae7640 1 -- 172.21.15.155:0/4032799695 >> v1:172.21.15.155:6789/0 conn(0x7f23e40b3c00 legacy=0x7f23e40b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23e9ae7640 1 -- 172.21.15.155:0/4032799695 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40cb8c0 con 0x7f23e40d08a0 2024-04-25T13:16:18.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23e9ae7640 1 --2- 172.21.15.155:0/4032799695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e40d0cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23e408e520 tx=0x7f23e002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35efa4bcb8931042 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.107+0000 7f23dbfff640 1 -- 172.21.15.155:0/4032799695 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0037070 con 0x7f23e40d08a0 2024-04-25T13:16:18.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23dbfff640 1 -- 172.21.15.155:0/4032799695 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e002ae50 con 0x7f23e40d08a0 2024-04-25T13:16:18.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23dbfff640 1 -- 172.21.15.155:0/4032799695 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0032860 con 0x7f23e40d08a0 2024-04-25T13:16:18.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 -- 172.21.15.155:0/4032799695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 msgr2=0x7f23e40d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 --2- 172.21.15.155:0/4032799695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e40d0cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f23e408e520 tx=0x7f23e002a300 comp rx=0 tx=0).stop 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 -- 172.21.15.155:0/4032799695 shutdown_connections 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 --2- 172.21.15.155:0/4032799695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e40d0cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 --2- 172.21.15.155:0/4032799695 >> v2:172.21.15.191:3300/0 conn(0x7f23e41554e0 0x7f23e415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 -- 172.21.15.155:0/4032799695 >> 172.21.15.155:0/4032799695 conn(0x7f23e4074d50 msgr2=0x7f23e4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 -- 172.21.15.155:0/4032799695 shutdown_connections 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.108+0000 7f23eb54a640 1 -- 172.21.15.155:0/4032799695 wait complete. 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.109+0000 7f23eb54a640 1 Processor -- start 2024-04-25T13:16:18.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.109+0000 7f23eb54a640 1 -- start start 2024-04-25T13:16:18.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23eb54a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40b3c00 0x7f23e415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23eb54a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e41f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23eb54a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e41554e0 0x7f23e4150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23eb54a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23e40b4430 con 0x7f23e40d08a0 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23eb54a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f23e40b4150 con 0x7f23e40b3c00 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23eb54a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f23e40b4710 con 0x7f23e41554e0 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23e8ae5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e41f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23e8ae5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e41f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54622/0 (socket says 172.21.15.155:54622) 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23e8ae5640 1 -- 172.21.15.155:0/1286921406 learned_addr learned my addr 172.21.15.155:0/1286921406 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23e92e6640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40b3c00 0x7f23e415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23e9ae7640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e41554e0 0x7f23e4150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.110+0000 7f23e8ae5640 1 -- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e41554e0 msgr2=0x7f23e4150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e8ae5640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e41554e0 0x7f23e4150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e8ae5640 1 -- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40b3c00 msgr2=0x7f23e415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e8ae5640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40b3c00 0x7f23e415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e8ae5640 1 -- 172.21.15.155:0/1286921406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e41f5050 con 0x7f23e40d08a0 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e92e6640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40b3c00 0x7f23e415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:18.113 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e9ae7640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e41554e0 0x7f23e4150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23e8ae5640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e41f4b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23d400c450 tx=0x7f23d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4018070 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40074a0 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e41f0bc0 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4004a20 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.111+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e41f0e80 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.112+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4068e40 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.112+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23d401b070 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.113+0000 7f23d9ffb640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f23c806c8f0 0x7f23c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.113+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f23d408aa70 con 0x7f23e40d08a0 2024-04-25T13:16:18.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.113+0000 7f23e92e6640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f23c806c8f0 0x7f23c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.113+0000 7f23e92e6640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f23c806c8f0 0x7f23c806edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009f50 tx=0x7f23dc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.117+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23e41558c0 con 0x7f23e40d08a0 2024-04-25T13:16:18.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.327+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23e40cc260 con 0x7f23e40d08a0 2024-04-25T13:16:18.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.327+0000 7f23d9ffb640 1 -- 172.21.15.155:0/1286921406 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5527 (secure 0 0 0) 0x7f23d4059e20 con 0x7f23e40d08a0 2024-04-25T13:16:18.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:18.328 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:16:18.328 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 3 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f23c806c8f0 msgr2=0x7f23c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f23c806c8f0 0x7f23c806edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009f50 tx=0x7f23dc00b040 comp rx=0 tx=0).stop 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 msgr2=0x7f23e41f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e41f4b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23d400c450 tx=0x7f23d400c910 comp rx=0 tx=0).stop 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 shutdown_connections 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f23c806c8f0 0x7f23c806edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23e41554e0 0x7f23e4150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23e40d08a0 0x7f23e41f4b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.329+0000 7f23eb54a640 1 --2- 172.21.15.155:0/1286921406 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e40b3c00 0x7f23e415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.330+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 >> 172.21.15.155:0/1286921406 conn(0x7f23e4074d50 msgr2=0x7f23e40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.330+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 shutdown_connections 2024-04-25T13:16:18.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.330+0000 7f23eb54a640 1 -- 172.21.15.155:0/1286921406 wait complete. 2024-04-25T13:16:18.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:18.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.437+0000 7f9342e4e640 1 Processor -- start 2024-04-25T13:16:18.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.437+0000 7f9342e4e640 1 -- start start 2024-04-25T13:16:18.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f9342e4e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 0x7f933c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f9342e4e640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 0x7f933c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f9342e4e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f933c1558c0 con 0x7f933c1554e0 2024-04-25T13:16:18.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f9342e4e640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f933c0b4a80 con 0x7f933c0b5450 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f9342e4e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0cb8c0 con 0x7f933c0b3c00 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f93413eb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 0x7f933c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 0x7f933c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f9340bea640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f933c1554e0 0x7f933c15f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:51194/0 (socket says 172.21.15.155:51194) 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 0x7f933c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:43906/0 (socket says 172.21.15.155:43906) 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 -- 172.21.15.155:0/121917008 learned_addr learned my addr 172.21.15.155:0/121917008 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f93413eb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 0x7f933c0d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:51884/0 (socket says 172.21.15.155:51884) 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 -- 172.21.15.155:0/121917008 >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 msgr2=0x7f933c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 --2- 172.21.15.155:0/121917008 >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 0x7f933c0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 -- 172.21.15.155:0/121917008 >> v1:172.21.15.191:6789/0 conn(0x7f933c1554e0 legacy=0x7f933c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f933bfff640 1 -- 172.21.15.155:0/121917008 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0cbba0 con 0x7f933c0b3c00 2024-04-25T13:16:18.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.438+0000 7f93413eb640 1 --2- 172.21.15.155:0/121917008 >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 0x7f933c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.439+0000 7f933bfff640 1 --2- 172.21.15.155:0/121917008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 0x7f933c0b4f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9328009870 tx=0x7f932802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a58a939dc3bf238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.439+0000 7f933b7fe640 1 -- 172.21.15.155:0/121917008 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328037070 con 0x7f933c0b3c00 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.439+0000 7f933b7fe640 1 -- 172.21.15.155:0/121917008 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932802ae50 con 0x7f933c0b3c00 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.439+0000 7f933b7fe640 1 -- 172.21.15.155:0/121917008 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328032860 con 0x7f933c0b3c00 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 -- 172.21.15.155:0/121917008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 msgr2=0x7f933c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 --2- 172.21.15.155:0/121917008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 0x7f933c0b4f10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9328009870 tx=0x7f932802a300 comp rx=0 tx=0).stop 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 -- 172.21.15.155:0/121917008 shutdown_connections 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 --2- 172.21.15.155:0/121917008 >> v2:172.21.15.191:3300/0 conn(0x7f933c0b5450 0x7f933c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 --2- 172.21.15.155:0/121917008 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b3c00 0x7f933c0b4f10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 -- 172.21.15.155:0/121917008 >> 172.21.15.155:0/121917008 conn(0x7f933c074d50 msgr2=0x7f933c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 -- 172.21.15.155:0/121917008 shutdown_connections 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.440+0000 7f9342e4e640 1 -- 172.21.15.155:0/121917008 wait complete. 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.441+0000 7f9342e4e640 1 Processor -- start 2024-04-25T13:16:18.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.441+0000 7f9342e4e640 1 -- start start 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9342e4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 0x7f933c150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9342e4e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b5450 0x7f933c0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9342e4e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f933c1554e0 0x7f933c0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9342e4e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0b4710 con 0x7f933c0b3c00 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9342e4e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0b4430 con 0x7f933c1554e0 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9342e4e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f933c0b3580 con 0x7f933c0b5450 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 0x7f933c150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 0x7f933c150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54634/0 (socket says 172.21.15.155:54634) 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 -- 172.21.15.155:0/2766013183 learned_addr learned my addr 172.21.15.155:0/2766013183 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f933bfff640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b5450 0x7f933c0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f93413eb640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f933c1554e0 0x7f933c0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 -- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b5450 msgr2=0x7f933c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b5450 0x7f933c0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 -- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f933c1554e0 msgr2=0x7f933c0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f933c1554e0 0x7f933c0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 -- 172.21.15.155:0/2766013183 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0c40f0 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f9340bea640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 0x7f933c150200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f933000c400 tx=0x7f933000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.442+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300074e0 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.443+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9330007680 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.443+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330004a00 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.443+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c14eae0 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.443+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c14f080 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.444+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c1f25f0 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.444+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f933001a020 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.444+0000 7f93397fa640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f932006c8f0 0x7f932006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.444+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f933008afc0 con 0x7f933c0b3c00 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.444+0000 7f933bfff640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f932006c8f0 0x7f932006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.445+0000 7f933bfff640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f932006c8f0 0x7f932006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9328034000 tx=0x7f932802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.449+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f933c1558c0 con 0x7f933c0b3c00 2024-04-25T13:16:18.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.628+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f933c068e40 con 0x7f933c0b3c00 2024-04-25T13:16:18.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.629+0000 7f93397fa640 1 -- 172.21.15.155:0/2766013183 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12944 (secure 0 0 0) 0x7f9330059060 con 0x7f933c0b3c00 2024-04-25T13:16:18.629 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:18.629 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":17,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:12.618663+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f932006c8f0 msgr2=0x7f932006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f932006c8f0 0x7f932006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9328034000 tx=0x7f932802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 msgr2=0x7f933c150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 0x7f933c150200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f933000c400 tx=0x7f933000c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 shutdown_connections 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f933c1554e0 0x7f933c0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f932006c8f0 0x7f932006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f933c0b5450 0x7f933c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 --2- 172.21.15.155:0/2766013183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f933c0b3c00 0x7f933c150200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 >> 172.21.15.155:0/2766013183 conn(0x7f933c074d50 msgr2=0x7f933c0ce710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 shutdown_connections 2024-04-25T13:16:18.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.631+0000 7f9342e4e640 1 -- 172.21.15.155:0/2766013183 wait complete. 2024-04-25T13:16:18.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:16:18.644 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.743+0000 7f50d7a72640 1 Processor -- start 2024-04-25T13:16:18.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.743+0000 7f50d7a72640 1 -- start start 2024-04-25T13:16:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d7a72640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cb5c0 0x7f50d006f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d7a72640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50d00cae40 0x7f50d015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d7a72640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f50d00cb9a0 0x7f50d015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d7a72640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f50d006fd30 con 0x7f50d00cae40 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d7a72640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f50d00c9d90 con 0x7f50d00cb9a0 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d7a72640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00ca070 con 0x7f50d00cb5c0 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50d00cae40 0x7f50d015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50d00cae40 0x7f50d015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54638/0 (socket says 172.21.15.155:54638) 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 -- 172.21.15.155:0/919522189 learned_addr learned my addr 172.21.15.155:0/919522189 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 -- 172.21.15.155:0/919522189 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cb5c0 msgr2=0x7f50d006f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d600f640 1 --2- 172.21.15.155:0/919522189 >> v2:172.21.15.191:3300/0 conn(0x7f50d00cb9a0 0x7f50d015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d580e640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cb5c0 0x7f50d006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cb5c0 0x7f50d006f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 -- 172.21.15.155:0/919522189 >> v2:172.21.15.191:3300/0 conn(0x7f50d00cb9a0 msgr2=0x7f50d015b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 --2- 172.21.15.155:0/919522189 >> v2:172.21.15.191:3300/0 conn(0x7f50d00cb9a0 0x7f50d015b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d500d640 1 -- 172.21.15.155:0/919522189 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00ca350 con 0x7f50d00cae40 2024-04-25T13:16:18.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d600f640 1 --2- 172.21.15.155:0/919522189 >> v2:172.21.15.191:3300/0 conn(0x7f50d00cb9a0 0x7f50d015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.744+0000 7f50d580e640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cb5c0 0x7f50d006f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:18.746 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.745+0000 7f50d500d640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cae40 0x7f50d015b1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50d015c270 tx=0x7f50c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c318dc541e6fad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.745+0000 7f50d480c640 1 -- 172.21.15.155:0/919522189 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0037070 con 0x7f50d00cae40 2024-04-25T13:16:18.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.745+0000 7f50d480c640 1 -- 172.21.15.155:0/919522189 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c0032440 con 0x7f50d00cae40 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.745+0000 7f50d480c640 1 -- 172.21.15.155:0/919522189 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0032810 con 0x7f50d00cae40 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.745+0000 7f50d7a72640 1 -- 172.21.15.155:0/919522189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cae40 msgr2=0x7f50d015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.745+0000 7f50d7a72640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cae40 0x7f50d015b1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50d015c270 tx=0x7f50c002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 -- 172.21.15.155:0/919522189 shutdown_connections 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 --2- 172.21.15.155:0/919522189 >> v2:172.21.15.191:3300/0 conn(0x7f50d00cb9a0 0x7f50d015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cae40 0x7f50d015b1e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 --2- 172.21.15.155:0/919522189 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cb5c0 0x7f50d006f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 -- 172.21.15.155:0/919522189 >> 172.21.15.155:0/919522189 conn(0x7f50d0074d50 msgr2=0x7f50d0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 -- 172.21.15.155:0/919522189 shutdown_connections 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.746+0000 7f50d7a72640 1 -- 172.21.15.155:0/919522189 wait complete. 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.747+0000 7f50d7a72640 1 Processor -- start 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.747+0000 7f50d7a72640 1 -- start start 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.747+0000 7f50d7a72640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cae40 0x7f50d014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.747+0000 7f50d7a72640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 0x7f50d00ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.747+0000 7f50d7a72640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50d00cb9a0 0x7f50d01f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.747+0000 7f50d7a72640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50d006c450 con 0x7f50d00cb5c0 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d7a72640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00ca910 con 0x7f50d00cb9a0 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d7a72640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f50d006c5d0 con 0x7f50d00cae40 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 0x7f50d00ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 0x7f50d00ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54640/0 (socket says 172.21.15.155:54640) 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 -- 172.21.15.155:0/1230870404 learned_addr learned my addr 172.21.15.155:0/1230870404 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d580e640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cae40 0x7f50d014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d600f640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50d00cb9a0 0x7f50d01f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 -- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cae40 msgr2=0x7f50d014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cae40 0x7f50d014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 -- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50d00cb9a0 msgr2=0x7f50d01f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50d00cb9a0 0x7f50d01f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 -- 172.21.15.155:0/1230870404 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d01f47e0 con 0x7f50d00cb5c0 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d600f640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50d00cb9a0 0x7f50d01f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d500d640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 0x7f50d00ceee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50c002a220 tx=0x7f50c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0037040 con 0x7f50d00cb5c0 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c0042070 con 0x7f50d00cb5c0 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d00c7e10 con 0x7f50d00cb5c0 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0030bb0 con 0x7f50d00cb5c0 2024-04-25T13:16:18.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.748+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d00c83d0 con 0x7f50d00cb5c0 2024-04-25T13:16:18.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.749+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d01f1cd0 con 0x7f50d00cb5c0 2024-04-25T13:16:18.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.749+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50c0047460 con 0x7f50d00cb5c0 2024-04-25T13:16:18.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.750+0000 7f50c67fc640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f50b406c8f0 0x7f50b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:18.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.750+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f50c00ac430 con 0x7f50d00cb5c0 2024-04-25T13:16:18.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.750+0000 7f50d580e640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f50b406c8f0 0x7f50b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:18.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.750+0000 7f50d580e640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f50b406c8f0 0x7f50b406edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50cc006b10 tx=0x7f50cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:18.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.754+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50c0045360 con 0x7f50d00cb5c0 2024-04-25T13:16:18.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.927+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f50d0068f50 con 0x7f50d00cb5c0 2024-04-25T13:16:18.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.928+0000 7f50c67fc640 1 -- 172.21.15.155:0/1230870404 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f50c007ac40 con 0x7f50d00cb5c0 2024-04-25T13:16:18.928 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f50b406c8f0 msgr2=0x7f50b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f50b406c8f0 0x7f50b406edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50cc006b10 tx=0x7f50cc008040 comp rx=0 tx=0).stop 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 msgr2=0x7f50d00ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 0x7f50d00ceee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f50c002a220 tx=0x7f50c00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 shutdown_connections 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50d00cb9a0 0x7f50d01f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50d00cb5c0 0x7f50d00ceee0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f50b406c8f0 0x7f50b406edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 --2- 172.21.15.155:0/1230870404 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f50d00cae40 0x7f50d014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:18.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 >> 172.21.15.155:0/1230870404 conn(0x7f50d0074d50 msgr2=0x7f50d0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:18.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 shutdown_connections 2024-04-25T13:16:18.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:18.930+0000 7f50d7a72640 1 -- 172.21.15.155:0/1230870404 wait complete. 2024-04-25T13:16:18.940 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:16:19.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.036+0000 7faf8cd9b640 1 Processor -- start 2024-04-25T13:16:19.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.036+0000 7faf8cd9b640 1 -- start start 2024-04-25T13:16:19.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf8cd9b640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faf88144270 0x7faf8815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf8cd9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf880c9290 0x7faf88075460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf8cd9b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf88144650 con 0x7faf880c8e70 2024-04-25T13:16:19.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf8cd9b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faf8815f4e0 con 0x7faf880c9290 2024-04-25T13:16:19.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf8cd9b640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faf880ce080 con 0x7faf88144270 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf86d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf880c9290 0x7faf88075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf86d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faf880c9290 0x7faf88075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54642/0 (socket says 172.21.15.155:54642) 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.037+0000 7faf86d9d640 1 -- 172.21.15.155:0/341957977 learned_addr learned my addr 172.21.15.155:0/341957977 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf8659c640 1 --2- 172.21.15.155:0/341957977 >> v2:172.21.15.191:3300/0 conn(0x7faf88144270 0x7faf8815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf86d9d640 1 -- 172.21.15.155:0/341957977 >> v2:172.21.15.191:3300/0 conn(0x7faf88144270 msgr2=0x7faf8815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf86d9d640 1 --2- 172.21.15.155:0/341957977 >> v2:172.21.15.191:3300/0 conn(0x7faf88144270 0x7faf8815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf86d9d640 1 -- 172.21.15.155:0/341957977 >> v1:172.21.15.155:6789/0 conn(0x7faf880c8e70 legacy=0x7faf88074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf86d9d640 1 -- 172.21.15.155:0/341957977 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8815b0b0 con 0x7faf880c9290 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf86d9d640 1 --2- 172.21.15.155:0/341957977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88075460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf8806c900 tx=0x7faf8002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c145be7892667a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf8559a640 1 -- 172.21.15.155:0/341957977 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80037070 con 0x7faf880c9290 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf8559a640 1 -- 172.21.15.155:0/341957977 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8002ae50 con 0x7faf880c9290 2024-04-25T13:16:19.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.038+0000 7faf8559a640 1 -- 172.21.15.155:0/341957977 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf80032860 con 0x7faf880c9290 2024-04-25T13:16:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 -- 172.21.15.155:0/341957977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 msgr2=0x7faf88075460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/341957977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88075460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf8806c900 tx=0x7faf8002a300 comp rx=0 tx=0).stop 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 -- 172.21.15.155:0/341957977 shutdown_connections 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/341957977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88075460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/341957977 >> v2:172.21.15.191:3300/0 conn(0x7faf88144270 0x7faf8815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 -- 172.21.15.155:0/341957977 >> 172.21.15.155:0/341957977 conn(0x7faf8806b920 msgr2=0x7faf8806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 -- 172.21.15.155:0/341957977 shutdown_connections 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.039+0000 7faf8cd9b640 1 -- 172.21.15.155:0/341957977 wait complete. 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.040+0000 7faf8cd9b640 1 Processor -- start 2024-04-25T13:16:19.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.040+0000 7faf8cd9b640 1 -- start start 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8cd9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf880c8e70 0x7faf8813a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8cd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8cd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88144270 0x7faf88142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8cd9b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf8815b8e0 con 0x7faf880c9290 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8cd9b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faf8815b600 con 0x7faf88144270 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8cd9b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faf880ce360 con 0x7faf880c8e70 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54646/0 (socket says 172.21.15.155:54646) 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 -- 172.21.15.155:0/1262288449 learned_addr learned my addr 172.21.15.155:0/1262288449 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:19.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf86d9d640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88144270 0x7faf88142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 -- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf880c8e70 msgr2=0x7faf8813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf8659c640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf880c8e70 0x7faf8813a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf880c8e70 0x7faf8813a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 -- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88144270 msgr2=0x7faf88142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88144270 0x7faf88142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf85d9b640 1 -- 172.21.15.155:0/1262288449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf881f0f40 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.041+0000 7faf86d9d640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88144270 0x7faf88142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.042+0000 7faf85d9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88141ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c400 tx=0x7faf7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.042+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0052d0 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.042+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c005490 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.042+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c007260 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.042+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf881f1220 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.042+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf881f17e0 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.043+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf88068e40 con 0x7faf880c9290 2024-04-25T13:16:19.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.043+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf7c007400 con 0x7faf880c9290 2024-04-25T13:16:19.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.044+0000 7faf76ffd640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faf6806c8f0 0x7faf6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.044+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faf7c08adc0 con 0x7faf880c9290 2024-04-25T13:16:19.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.044+0000 7faf8659c640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faf6806c8f0 0x7faf6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.044+0000 7faf8659c640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faf6806c8f0 0x7faf6806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf78008e50 tx=0x7faf780083a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.048+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf7c0594b0 con 0x7faf880c9290 2024-04-25T13:16:19.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.227+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7faf880cdc50 con 0x7faf880c9290 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.228+0000 7faf76ffd640 1 -- 172.21.15.155:0/1262288449 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7faf7c058db0 con 0x7faf880c9290 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout:[ 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: { 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "poolnum": 1, 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: "poolname": ".mgr" 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-25T13:16:19.228 INFO:teuthology.orchestra.run.smithi155.stdout:] 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faf6806c8f0 msgr2=0x7faf6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faf6806c8f0 0x7faf6806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf78008e50 tx=0x7faf780083a0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 msgr2=0x7faf88141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88141ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00c400 tx=0x7faf7c00c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 shutdown_connections 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faf88144270 0x7faf88142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf880c9290 0x7faf88141ae0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faf6806c8f0 0x7faf6806edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 --2- 172.21.15.155:0/1262288449 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faf880c8e70 0x7faf8813a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 >> 172.21.15.155:0/1262288449 conn(0x7faf8806b920 msgr2=0x7faf88140250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 shutdown_connections 2024-04-25T13:16:19.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.230+0000 7faf8cd9b640 1 -- 172.21.15.155:0/1262288449 wait complete. 2024-04-25T13:16:19.240 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:16:19.240 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:16:19.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.341+0000 7f845335d640 1 Processor -- start 2024-04-25T13:16:19.341 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.341+0000 7f845335d640 1 -- start start 2024-04-25T13:16:19.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f845335d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c155130 0x7f844c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f845335d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844c155510 0x7f844c073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f845335d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f844c0cde80 0x7f844c073690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f845335d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f844c15e5d0 con 0x7f844c155510 2024-04-25T13:16:19.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f845335d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f844c15bfa0 con 0x7f844c0cde80 2024-04-25T13:16:19.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f845335d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f844c0c57a0 con 0x7f844c155130 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844c155510 0x7f844c073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f844c155510 0x7f844c073150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54648/0 (socket says 172.21.15.155:54648) 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 -- 172.21.15.155:0/3585601700 learned_addr learned my addr 172.21.15.155:0/3585601700 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84518fa640 1 --2- 172.21.15.155:0/3585601700 >> v2:172.21.15.191:3300/0 conn(0x7f844c0cde80 0x7f844c073690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 -- 172.21.15.155:0/3585601700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c155130 msgr2=0x7f844c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 --2- 172.21.15.155:0/3585601700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c155130 0x7f844c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 -- 172.21.15.155:0/3585601700 >> v2:172.21.15.191:3300/0 conn(0x7f844c0cde80 msgr2=0x7f844c073690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 --2- 172.21.15.155:0/3585601700 >> v2:172.21.15.191:3300/0 conn(0x7f844c0cde80 0x7f844c073690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.342+0000 7f84508f8640 1 -- 172.21.15.155:0/3585601700 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c15e800 con 0x7f844c155510 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.343+0000 7f84508f8640 1 --2- 172.21.15.155:0/3585601700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c073150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f844c072dd0 tx=0x7f843c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ed67d7fac6fc77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.343+0000 7f8443fff640 1 -- 172.21.15.155:0/3585601700 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c037070 con 0x7f844c155510 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.343+0000 7f8443fff640 1 -- 172.21.15.155:0/3585601700 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c032440 con 0x7f844c155510 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.343+0000 7f8443fff640 1 -- 172.21.15.155:0/3585601700 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c032810 con 0x7f844c155510 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 -- 172.21.15.155:0/3585601700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 msgr2=0x7f844c073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 --2- 172.21.15.155:0/3585601700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c073150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f844c072dd0 tx=0x7f843c02a1e0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 -- 172.21.15.155:0/3585601700 shutdown_connections 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 --2- 172.21.15.155:0/3585601700 >> v2:172.21.15.191:3300/0 conn(0x7f844c0cde80 0x7f844c073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 --2- 172.21.15.155:0/3585601700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c073150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 --2- 172.21.15.155:0/3585601700 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c155130 0x7f844c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.345 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 -- 172.21.15.155:0/3585601700 >> 172.21.15.155:0/3585601700 conn(0x7f844c068360 msgr2=0x7f844c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 -- 172.21.15.155:0/3585601700 shutdown_connections 2024-04-25T13:16:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.344+0000 7f845335d640 1 -- 172.21.15.155:0/3585601700 wait complete. 2024-04-25T13:16:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.345+0000 7f845335d640 1 Processor -- start 2024-04-25T13:16:19.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.345+0000 7f845335d640 1 -- start start 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.345+0000 7f845335d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c0cde80 0x7f844c074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.345+0000 7f845335d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c155130 0x7f844c075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.345+0000 7f845335d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.345+0000 7f845335d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f844c15f080 con 0x7f844c155510 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f845335d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f844c15eda0 con 0x7f844c155130 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f845335d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f844c15f360 con 0x7f844c0cde80 2024-04-25T13:16:19.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c15c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54650/0 (socket says 172.21.15.155:54650) 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 -- 172.21.15.155:0/505744537 learned_addr learned my addr 172.21.15.155:0/505744537 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84508f8640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c155130 0x7f844c075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 -- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c0cde80 msgr2=0x7f844c074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c0cde80 0x7f844c074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 -- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c155130 msgr2=0x7f844c075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c155130 0x7f844c075290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 -- 172.21.15.155:0/505744537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844c1f5350 con 0x7f844c155510 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f84518fa640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c15c2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f844400c7f0 tx=0x7f844400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444015070 con 0x7f844c155510 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8444004220 con 0x7f844c155510 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844c1f12b0 con 0x7f844c155510 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8444007620 con 0x7f844c155510 2024-04-25T13:16:19.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.346+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f844c1f1870 con 0x7f844c155510 2024-04-25T13:16:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.347+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844c0cb6f0 con 0x7f844c155510 2024-04-25T13:16:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.348+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84440079d0 con 0x7f844c155510 2024-04-25T13:16:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.348+0000 7f8441ffb640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f843006c8f0 0x7f843006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.348+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f844408b830 con 0x7f844c155510 2024-04-25T13:16:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.348+0000 7f84510f9640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f843006c8f0 0x7f843006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.348+0000 7f84510f9640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f843006c8f0 0x7f843006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f844800ab90 tx=0x7f8448009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.352+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8444059fb0 con 0x7f844c155510 2024-04-25T13:16:19.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.526+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f844c0cad50 con 0x7f844c155510 2024-04-25T13:16:19.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.637+0000 7f8441ffb640 1 -- 172.21.15.155:0/505744537 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f84440598b0 con 0x7f844c155510 2024-04-25T13:16:19.638 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_metadata' created 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f843006c8f0 msgr2=0x7f843006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f843006c8f0 0x7f843006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f844800ab90 tx=0x7f8448009250 comp rx=0 tx=0).stop 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 msgr2=0x7f844c15c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c15c2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f844400c7f0 tx=0x7f844400ccb0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 shutdown_connections 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f844c155510 0x7f844c15c2c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f844c155130 0x7f844c075290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f843006c8f0 0x7f843006edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 --2- 172.21.15.155:0/505744537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f844c0cde80 0x7f844c074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 >> 172.21.15.155:0/505744537 conn(0x7f844c068360 msgr2=0x7f844c072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:19.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 shutdown_connections 2024-04-25T13:16:19.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.641+0000 7f845335d640 1 -- 172.21.15.155:0/505744537 wait complete. 2024-04-25T13:16:19.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T13:16:19.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.758+0000 7f7fb95f0640 1 Processor -- start 2024-04-25T13:16:19.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.758+0000 7f7fb95f0640 1 -- start start 2024-04-25T13:16:19.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb95f0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb40cc6f0 0x7f7fb40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb95f0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb40d1510 con 0x7f7fb40cbd40 2024-04-25T13:16:19.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb95f0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb415b5d0 con 0x7f7fb41554e0 2024-04-25T13:16:19.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb95f0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb40cced0 con 0x7f7fb40cc6f0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb37fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7fb40cbd40 0x7f7fb40cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57698/0 (socket says 172.21.15.155:57698) 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb37fe640 1 -- 172.21.15.155:0/3778527375 learned_addr learned my addr 172.21.15.155:0/3778527375 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb27fc640 1 --2- 172.21.15.155:0/3778527375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb40cc6f0 0x7f7fb40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677953213 0 0) 0x7f7fb40d1510 con 0x7f7fb40cbd40 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f9c003520 con 0x7f7fb40cbd40 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034283945 0 0) 0x7f7fb415b5d0 con 0x7f7fb41554e0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb40d1510 con 0x7f7fb41554e0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb27fc640 1 -- 172.21.15.155:0/3778527375 >> v1:172.21.15.191:6789/0 conn(0x7f7fb41554e0 legacy=0x7f7fb40d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.759+0000 7f7fb27fc640 1 -- 172.21.15.155:0/3778527375 >> v1:172.21.15.155:6789/0 conn(0x7f7fb40cbd40 legacy=0x7f7fb40cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.760+0000 7f7fb27fc640 1 -- 172.21.15.155:0/3778527375 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb415b8b0 con 0x7f7fb40cc6f0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.760+0000 7f7fb27fc640 1 --2- 172.21.15.155:0/3778527375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb40cc6f0 0x7f7fb40cb800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80097d0 tx=0x7f7fa802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343eb713b1d0e0ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.760+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8037070 con 0x7f7fb40cc6f0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.760+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa8032440 con 0x7f7fb40cc6f0 2024-04-25T13:16:19.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.760+0000 7f7fb1ffb640 1 -- 172.21.15.155:0/3778527375 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80327f0 con 0x7f7fb40cc6f0 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 -- 172.21.15.155:0/3778527375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb40cc6f0 msgr2=0x7f7fb40cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/3778527375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb40cc6f0 0x7f7fb40cb800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80097d0 tx=0x7f7fa802a210 comp rx=0 tx=0).stop 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 -- 172.21.15.155:0/3778527375 shutdown_connections 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/3778527375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb40cc6f0 0x7f7fb40cb800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 -- 172.21.15.155:0/3778527375 >> 172.21.15.155:0/3778527375 conn(0x7f7fb4074d50 msgr2=0x7f7fb4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 -- 172.21.15.155:0/3778527375 shutdown_connections 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.761+0000 7f7fb95f0640 1 -- 172.21.15.155:0/3778527375 wait complete. 2024-04-25T13:16:19.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.762+0000 7f7fb95f0640 1 Processor -- start 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.762+0000 7f7fb95f0640 1 -- start start 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb95f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 0x7f7fb40cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb95f0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb40cc6f0 0x7f7fb41f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb95f0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb41554e0 0x7f7fb4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb95f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb40d11e0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb95f0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb415bf00 con 0x7f7fb40cc6f0 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb95f0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb415b280 con 0x7f7fb41554e0 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 0x7f7fb40cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 0x7f7fb40cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54660/0 (socket says 172.21.15.155:54660) 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 -- 172.21.15.155:0/591735489 learned_addr learned my addr 172.21.15.155:0/591735489 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb27fc640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb40cc6f0 0x7f7fb41f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb37fe640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb41554e0 0x7f7fb4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 -- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb41554e0 msgr2=0x7f7fb4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb41554e0 0x7f7fb4150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 -- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb40cc6f0 msgr2=0x7f7fb41f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb40cc6f0 0x7f7fb41f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 -- 172.21.15.155:0/591735489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb4155bf0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.763+0000 7f7fb2ffd640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 0x7f7fb40cfd30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c460 tx=0x7f7fa400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.764+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4017070 con 0x7f7fb40cbd40 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.764+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa40052f0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.764+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb41f0be0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.764+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4003830 con 0x7f7fb40cbd40 2024-04-25T13:16:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.764+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb41588f0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.765+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb41586e0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.765+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fa401a070 con 0x7f7fb40cbd40 2024-04-25T13:16:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.765+0000 7f7f9b7fe640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.765+0000 7f7fb27fc640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.765+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f7fa408aca0 con 0x7f7fb40cbd40 2024-04-25T13:16:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.766+0000 7f7fb27fc640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7fa006c8f0 0x7f7fa006edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8034000 tx=0x7f7fa802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:19.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.770+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fa4058c60 con 0x7f7fb40cbd40 2024-04-25T13:16:19.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:19.945+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f7fb4068e40 con 0x7f7fb40cbd40 2024-04-25T13:16:20.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.640+0000 7f7f9b7fe640 1 -- 172.21.15.155:0/591735489 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f7fa405cf60 con 0x7f7fb40cbd40 2024-04-25T13:16:20.640 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data' created 2024-04-25T13:16:20.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7fa006c8f0 msgr2=0x7f7fa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7fa006c8f0 0x7f7fa006edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8034000 tx=0x7f7fa802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:20.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 msgr2=0x7f7fb40cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 0x7f7fb40cfd30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c460 tx=0x7f7fa400c920 comp rx=0 tx=0).stop 2024-04-25T13:16:20.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 shutdown_connections 2024-04-25T13:16:20.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7fb41554e0 0x7f7fb4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7fb40cc6f0 0x7f7fb41f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 --2- 172.21.15.155:0/591735489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fb40cbd40 0x7f7fb40cfd30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 >> 172.21.15.155:0/591735489 conn(0x7f7fb4074d50 msgr2=0x7f7fb4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:20.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 shutdown_connections 2024-04-25T13:16:20.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.642+0000 7f7fb95f0640 1 -- 172.21.15.155:0/591735489 wait complete. 2024-04-25T13:16:20.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:16:20.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.765+0000 7ff0aa5f7640 1 Processor -- start 2024-04-25T13:16:20.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.765+0000 7ff0aa5f7640 1 -- start start 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0aa5f7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 0x7ff0a4158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0aa5f7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0a4071f00 0x7ff0a4072570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0aa5f7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a40cd4e0 con 0x7ff0a40c8960 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0aa5f7640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a41585c0 con 0x7ff0a4071f00 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0aa5f7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a4151dc0 con 0x7ff0a40c5c50 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0a8b94640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff0a40c8960 0x7ff0a40c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57708/0 (socket says 172.21.15.155:57708) 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0a8b94640 1 -- 172.21.15.155:0/3276826202 learned_addr learned my addr 172.21.15.155:0/3276826202 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0a3fff640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 0x7ff0a4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/3276826202 >> v2:172.21.15.191:3300/0 conn(0x7ff0a4071f00 0x7ff0a4072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896132663 0 0) 0x7ff0a40cd4e0 con 0x7ff0a40c8960 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.766+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff08c003520 con 0x7ff0a40c8960 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3517133348 0 0) 0x7ff08c003520 con 0x7ff0a40c8960 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 msgr2=0x7ff0a4158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 0x7ff0a4158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 >> v2:172.21.15.191:3300/0 conn(0x7ff0a4071f00 msgr2=0x7ff0a4072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 --2- 172.21.15.155:0/3276826202 >> v2:172.21.15.191:3300/0 conn(0x7ff0a4071f00 0x7ff0a4072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a4072ab0 con 0x7ff0a40c8960 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7ff09c0019f0 con 0x7ff0a40c8960 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 >> v1:172.21.15.155:6789/0 conn(0x7ff0a40c8960 legacy=0x7ff0a40c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff08c0039b0 0x7ff08c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff08c004800 0x7ff08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 0x7ff08c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a41585c0 con 0x7ff08c004800 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a4151dc0 con 0x7ff08c0039b0 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c00b9c0 con 0x7ff0a40c5c50 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff08c004800 0x7ff08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a3fff640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff08c0039b0 0x7ff08c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a8b94640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 0x7ff08c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a37fe640 1 -- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 msgr2=0x7ff08c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a40c5c50 0x7ff08c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a37fe640 1 -- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff08c0039b0 msgr2=0x7ff08c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff08c0039b0 0x7ff08c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.767+0000 7ff0a37fe640 1 -- 172.21.15.155:0/3276826202 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c003520 con 0x7ff08c004800 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff08c004800 0x7ff08c004c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff098009ac0 tx=0x7ff08c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eeb72b16bca9f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098036070 con 0x7ff08c004800 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098031400 con 0x7ff08c004800 2024-04-25T13:16:20.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0a2ffd640 1 -- 172.21.15.155:0/3276826202 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098009690 con 0x7ff08c004800 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/3276826202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff08c004800 msgr2=0x7ff08c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/3276826202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff08c004800 0x7ff08c004c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff098009ac0 tx=0x7ff08c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.768+0000 7ff0a8b94640 1 -- 172.21.15.155:0/3276826202 reap_dead start 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.769+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/3276826202 shutdown_connections 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.769+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/3276826202 >> 172.21.15.155:0/3276826202 conn(0x7ff0a406d660 msgr2=0x7ff0a4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.769+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/3276826202 shutdown_connections 2024-04-25T13:16:20.772 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.769+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/3276826202 wait complete. 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.770+0000 7ff0aa5f7640 1 Processor -- start 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.770+0000 7ff0aa5f7640 1 -- start start 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a4141ce0 0x7ff0a41ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0a41420c0 0x7ff0a4152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 0x7ff0a4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a40c68a0 con 0x7ff0a4151f70 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a40711d0 con 0x7ff0a41420c0 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a4071420 con 0x7ff0a4141ce0 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 0x7ff0a4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 0x7ff0a4153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54684/0 (socket says 172.21.15.155:54684) 2024-04-25T13:16:20.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 -- 172.21.15.155:0/1700116428 learned_addr learned my addr 172.21.15.155:0/1700116428 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0a41420c0 0x7ff0a4152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a3fff640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a4141ce0 0x7ff0a41ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 -- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a4141ce0 msgr2=0x7ff0a41ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a4141ce0 0x7ff0a41ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 -- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0a41420c0 msgr2=0x7ff0a4152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0a41420c0 0x7ff0a4152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 -- 172.21.15.155:0/1700116428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a4155510 con 0x7ff0a4151f70 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a37fe640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0a41420c0 0x7ff0a4152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a3fff640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a4141ce0 0x7ff0a41ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a8b94640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 0x7ff0a4153410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0013d0 tx=0x7ff09c00a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00ad80 con 0x7ff0a4151f70 2024-04-25T13:16:20.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c018070 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c013630 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a41557f0 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.771+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a4155db0 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.772+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a41560c0 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.773+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff09c0137d0 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.773+0000 7ff0a0ff9640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff09006c920 0x7ff09006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.773+0000 7ff0a3fff640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff09006c920 0x7ff09006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.773+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7ff09c08c2b0 con 0x7ff0a4151f70 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.774+0000 7ff0a3fff640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff09006c920 0x7ff09006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff094009a60 tx=0x7ff094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:20.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.778+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff09c05a6b0 con 0x7ff0a4151f70 2024-04-25T13:16:20.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:20.989+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff0a4068f50 con 0x7ff0a4151f70 2024-04-25T13:16:21.661 INFO:teuthology.orchestra.run.smithi155.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T13:16:21.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.661+0000 7ff0a0ff9640 1 -- 172.21.15.155:0/1700116428 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff09c059fb0 con 0x7ff0a4151f70 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.665+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff09006c920 msgr2=0x7ff09006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.665+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff09006c920 0x7ff09006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff094009a60 tx=0x7ff094008040 comp rx=0 tx=0).stop 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.665+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 msgr2=0x7ff0a4153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.665+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 0x7ff0a4153410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0013d0 tx=0x7ff09c00a750 comp rx=0 tx=0).stop 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.666+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 shutdown_connections 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.666+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a4151f70 0x7ff0a4153410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.666+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0a41420c0 0x7ff0a4152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.666+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff09006c920 0x7ff09006ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.666+0000 7ff0aa5f7640 1 --2- 172.21.15.155:0/1700116428 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0a4141ce0 0x7ff0a41ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.666+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 >> 172.21.15.155:0/1700116428 conn(0x7ff0a406d660 msgr2=0x7ff0a40cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.668+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 shutdown_connections 2024-04-25T13:16:21.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.668+0000 7ff0aa5f7640 1 -- 172.21.15.155:0/1700116428 wait complete. 2024-04-25T13:16:21.687 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T13:16:21.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T13:16:21.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.793+0000 7fbfea8a3640 1 Processor -- start 2024-04-25T13:16:21.793 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.793+0000 7fbfea8a3640 1 -- start start 2024-04-25T13:16:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfea8a3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfe415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfea8a3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe415ebc0 con 0x7fbfe415b800 2024-04-25T13:16:21.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfea8a3640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe415ee80 con 0x7fbfe4155990 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfea8a3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe415f160 con 0x7fbfe415cd00 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe8e40640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbfe415b800 0x7fbfe415bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:57718/0 (socket says 172.21.15.155:57718) 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe8e40640 1 -- 172.21.15.155:0/2014681549 learned_addr learned my addr 172.21.15.155:0/2014681549 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648506755 0 0) 0x7fbfe415ebc0 con 0x7fbfe415b800 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe37fe640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfe415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfcc003520 con 0x7fbfe415b800 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2014129287 0 0) 0x7fbfcc003520 con 0x7fbfe415b800 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 msgr2=0x7fbfe415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfe415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 >> v1:172.21.15.191:6789/0 conn(0x7fbfe4155990 legacy=0x7fbfe40d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe415f440 con 0x7fbfe415b800 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fbfdc0019f0 con 0x7fbfe415b800 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe37fe640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfe415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:21.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 >> v1:172.21.15.155:6789/0 conn(0x7fbfe415b800 legacy=0x7fbfe415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfcc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc003fd0 0x7fbfcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfcc004d40 0x7fbfcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe415f160 con 0x7fbfcc004d40 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc00bbb0 con 0x7fbfcc003fd0 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.794+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbfcc00bdb0 con 0x7fbfe415cd00 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfcc004d40 0x7fbfcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe3fff640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfcc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe37fe640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc003fd0 0x7fbfcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 -- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 msgr2=0x7fbfcc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfe415cd00 0x7fbfcc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 -- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc003fd0 msgr2=0x7fbfcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfcc003fd0 0x7fbfcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 -- 172.21.15.155:0/2014681549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc003520 con 0x7fbfcc004d40 2024-04-25T13:16:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.795+0000 7fbfe8e40640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfcc004d40 0x7fbfcc0051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00a850 tx=0x7fbfcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953284057a2b5eac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00a4a0 con 0x7fbfcc004d40 2024-04-25T13:16:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc02f070 con 0x7fbfcc004d40 2024-04-25T13:16:21.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfe2ffd640 1 -- 172.21.15.155:0/2014681549 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc02bd20 con 0x7fbfcc004d40 2024-04-25T13:16:21.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfea8a3640 1 -- 172.21.15.155:0/2014681549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfcc004d40 msgr2=0x7fbfcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/2014681549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfcc004d40 0x7fbfcc0051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00a850 tx=0x7fbfcc005830 comp rx=0 tx=0).stop 2024-04-25T13:16:21.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfe8e40640 1 -- 172.21.15.155:0/2014681549 reap_dead start 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfea8a3640 1 -- 172.21.15.155:0/2014681549 shutdown_connections 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfea8a3640 1 -- 172.21.15.155:0/2014681549 >> 172.21.15.155:0/2014681549 conn(0x7fbfe4074f30 msgr2=0x7fbfe4075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfea8a3640 1 -- 172.21.15.155:0/2014681549 shutdown_connections 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.796+0000 7fbfea8a3640 1 -- 172.21.15.155:0/2014681549 wait complete. 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.797+0000 7fbfea8a3640 1 Processor -- start 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.797+0000 7fbfea8a3640 1 -- start start 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfea8a3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc004d40 0x7fbfe41f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfea8a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 0x7fbfe40c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfea8a3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfe40c6210 0x7fbfe41e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfea8a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe415c360 con 0x7fbfe40c43e0 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfea8a3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe415fa00 con 0x7fbfe40c6210 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfea8a3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe415c4e0 con 0x7fbfcc004d40 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 0x7fbfe40c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 0x7fbfe40c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54708/0 (socket says 172.21.15.155:54708) 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 -- 172.21.15.155:0/851435181 learned_addr learned my addr 172.21.15.155:0/851435181 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:21.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe3fff640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc004d40 0x7fbfe41f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe8e40640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfe40c6210 0x7fbfe41e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 -- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc004d40 msgr2=0x7fbfe41f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc004d40 0x7fbfe41f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 -- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfe40c6210 msgr2=0x7fbfe41e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfe40c6210 0x7fbfe41e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.798+0000 7fbfe37fe640 1 -- 172.21.15.155:0/851435181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe41f2000 con 0x7fbfe40c43e0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.799+0000 7fbfe37fe640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 0x7fbfe40c6ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8011620 tx=0x7fbfd8011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.799+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8019070 con 0x7fbfe40c43e0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.799+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd8004220 con 0x7fbfe40c43e0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.799+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe4158210 con 0x7fbfe40c43e0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.799+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800f040 con 0x7fbfe40c43e0 2024-04-25T13:16:21.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.799+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41587d0 con 0x7fbfe40c43e0 2024-04-25T13:16:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.800+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe415c120 con 0x7fbfe40c43e0 2024-04-25T13:16:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.800+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfd800f720 con 0x7fbfe40c43e0 2024-04-25T13:16:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.801+0000 7fbfe0ff9640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbfd006c8f0 0x7fbfd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.801+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbfd808bd80 con 0x7fbfe40c43e0 2024-04-25T13:16:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.801+0000 7fbfe3fff640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbfd006c8f0 0x7fbfd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:21.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.801+0000 7fbfe3fff640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbfd006c8f0 0x7fbfd006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40017e0 tx=0x7fbfd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:21.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.805+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfe415c120 con 0x7fbfe40c43e0 2024-04-25T13:16:21.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:21.988+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fbfe40c5610 con 0x7fbfe40c43e0 2024-04-25T13:16:22.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.661+0000 7fbfe0ff9640 1 -- 172.21.15.155:0/851435181 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fbfd8059b60 con 0x7fbfe40c43e0 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.664+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbfd006c8f0 msgr2=0x7fbfd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.664+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbfd006c8f0 0x7fbfd006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40017e0 tx=0x7fbfd4009040 comp rx=0 tx=0).stop 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.664+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 msgr2=0x7fbfe40c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.664+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 0x7fbfe40c6ef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8011620 tx=0x7fbfd8011ae0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 shutdown_connections 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbfe40c6210 0x7fbfe41e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe40c43e0 0x7fbfe40c6ef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbfd006c8f0 0x7fbfd006edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 --2- 172.21.15.155:0/851435181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbfcc004d40 0x7fbfe41f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 >> 172.21.15.155:0/851435181 conn(0x7fbfe4074f30 msgr2=0x7fbfe40d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 shutdown_connections 2024-04-25T13:16:22.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.665+0000 7fbfea8a3640 1 -- 172.21.15.155:0/851435181 wait complete. 2024-04-25T13:16:22.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:16:22.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.788+0000 7f5a40d44640 1 Processor -- start 2024-04-25T13:16:22.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.788+0000 7f5a40d44640 1 -- start start 2024-04-25T13:16:22.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a40d44640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a3c1552c0 0x7f5a3c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a40d44640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a3c0c7c40 0x7f5a3c0d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a40d44640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a40d44640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a3c0ce110 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a40d44640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5a3c0ccf60 con 0x7f5a3c1552c0 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a40d44640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c0cd220 con 0x7f5a3c0d0d10 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a3c0c7c40 0x7f5a3c0d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a3c0c7c40 0x7f5a3c0d07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50668/0 (socket says 172.21.15.155:50668) 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 -- 172.21.15.155:0/3373613097 learned_addr learned my addr 172.21.15.155:0/3373613097 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a3a59c640 1 --2- 172.21.15.155:0/3373613097 >> v2:172.21.15.191:3300/0 conn(0x7f5a3c1552c0 0x7f5a3c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 -- 172.21.15.155:0/3373613097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 msgr2=0x7f5a3c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 --2- 172.21.15.155:0/3373613097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 -- 172.21.15.155:0/3373613097 >> v2:172.21.15.191:3300/0 conn(0x7f5a3c1552c0 msgr2=0x7f5a3c15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 --2- 172.21.15.155:0/3373613097 >> v2:172.21.15.191:3300/0 conn(0x7f5a3c1552c0 0x7f5a3c15bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.789+0000 7f5a39d9b640 1 -- 172.21.15.155:0/3373613097 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c0cd500 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.790+0000 7f5a39d9b640 1 --2- 172.21.15.155:0/3373613097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c0d07d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0cb630 tx=0x7f5a3002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0edc2ec0fb884c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.790+0000 7f5a3959a640 1 -- 172.21.15.155:0/3373613097 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30004030 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.790+0000 7f5a3959a640 1 -- 172.21.15.155:0/3373613097 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a300041d0 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.790+0000 7f5a3959a640 1 -- 172.21.15.155:0/3373613097 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30003610 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 -- 172.21.15.155:0/3373613097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 msgr2=0x7f5a3c0d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 --2- 172.21.15.155:0/3373613097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c0d07d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0cb630 tx=0x7f5a3002a250 comp rx=0 tx=0).stop 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 -- 172.21.15.155:0/3373613097 shutdown_connections 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 --2- 172.21.15.155:0/3373613097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 --2- 172.21.15.155:0/3373613097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c0d07d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 --2- 172.21.15.155:0/3373613097 >> v2:172.21.15.191:3300/0 conn(0x7f5a3c1552c0 0x7f5a3c15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 -- 172.21.15.155:0/3373613097 >> 172.21.15.155:0/3373613097 conn(0x7f5a3c074d50 msgr2=0x7f5a3c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 -- 172.21.15.155:0/3373613097 shutdown_connections 2024-04-25T13:16:22.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.791+0000 7f5a40d44640 1 -- 172.21.15.155:0/3373613097 wait complete. 2024-04-25T13:16:22.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.792+0000 7f5a40d44640 1 Processor -- start 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.792+0000 7f5a40d44640 1 -- start start 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a40d44640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a40d44640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a40d44640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a3c1552c0 0x7f5a3c1f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a40d44640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c0cdda0 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a40d44640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c0cdac0 con 0x7f5a3c1552c0 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a40d44640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c1556a0 con 0x7f5a3c0d0d10 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50670/0 (socket says 172.21.15.155:50670) 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 -- 172.21.15.155:0/122045383 learned_addr learned my addr 172.21.15.155:0/122045383 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3ad9d640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a3c1552c0 0x7f5a3c1f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a39d9b640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 -- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 msgr2=0x7f5a3c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 -- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a3c1552c0 msgr2=0x7f5a3c1f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a3c1552c0 0x7f5a3c1f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 -- 172.21.15.155:0/122045383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c1f49b0 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3ad9d640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a3c1552c0 0x7f5a3c1f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.793+0000 7f5a3a59c640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c158650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c820 tx=0x7f5a2c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.794+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c015070 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.794+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c004240 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.794+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00ce10 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.794+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c1f4c90 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.794+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c1f5250 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.795+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c152ce0 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.795+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a2c007830 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.795+0000 7f5a2affd640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a1c06c920 0x7f5a1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:22.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.795+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f5a2c08bc30 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.795+0000 7f5a39d9b640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a1c06c920 0x7f5a1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:22.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.796+0000 7f5a39d9b640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a1c06c920 0x7f5a1c06ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a30033000 tx=0x7f5a3002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:22.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.800+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a3c152ce0 con 0x7f5a3c0c7c40 2024-04-25T13:16:22.976 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:22.976+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5a3c068d30 con 0x7f5a3c0c7c40 2024-04-25T13:16:24.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.671+0000 7f5a2affd640 1 -- 172.21.15.155:0/122045383 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f5a2c059ea0 con 0x7f5a3c0c7c40 2024-04-25T13:16:24.672 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data_ec' created 2024-04-25T13:16:24.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a1c06c920 msgr2=0x7f5a1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a1c06c920 0x7f5a1c06ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a30033000 tx=0x7f5a3002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:24.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 msgr2=0x7f5a3c158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c158650 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c820 tx=0x7f5a2c00cce0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 shutdown_connections 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a3c1552c0 0x7f5a3c1f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a1c06c920 0x7f5a1c06ede0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a30033000 tx=0x7f5a3002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a3c0d0d10 0x7f5a3c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 --2- 172.21.15.155:0/122045383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0c7c40 0x7f5a3c158650 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 >> 172.21.15.155:0/122045383 conn(0x7f5a3c074d50 msgr2=0x7f5a3c150d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 shutdown_connections 2024-04-25T13:16:24.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.675+0000 7f5a40d44640 1 -- 172.21.15.155:0/122045383 wait complete. 2024-04-25T13:16:24.697 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T13:16:24.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.802+0000 7f7b340cf640 1 Processor -- start 2024-04-25T13:16:24.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.802+0000 7f7b340cf640 1 -- start start 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b340cf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b2c155200 0x7f7b2c0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b340cf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0caf90 con 0x7f7b2c0c9cd0 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b340cf640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0ca410 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b340cf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c06c490 con 0x7f7b2c155200 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b31e6b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b2c155200 0x7f7b2c0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b31e6b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7b2c155200 0x7f7b2c0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50680/0 (socket says 172.21.15.155:50680) 2024-04-25T13:16:24.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b31e6b640 1 -- 172.21.15.155:0/3832061433 learned_addr learned my addr 172.21.15.155:0/3832061433 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:24.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b31e6b640 1 -- 172.21.15.155:0/3832061433 >> v1:172.21.15.191:6789/0 conn(0x7f7b2c0cbde0 legacy=0x7f7b2c15e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:24.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b31e6b640 1 -- 172.21.15.155:0/3832061433 >> v1:172.21.15.155:6789/0 conn(0x7f7b2c0c9cd0 legacy=0x7f7b2c06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.803+0000 7f7b31e6b640 1 -- 172.21.15.155:0/3832061433 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0ca6f0 con 0x7f7b2c155200 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b31e6b640 1 --2- 172.21.15.155:0/3832061433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c155200 0x7f7b2c0cb8a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009870 tx=0x7f7b2802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faee6d8d8afee6ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b30e69640 1 -- 172.21.15.155:0/3832061433 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b28037070 con 0x7f7b2c155200 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b30e69640 1 -- 172.21.15.155:0/3832061433 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b28032640 con 0x7f7b2c155200 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b30e69640 1 -- 172.21.15.155:0/3832061433 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b28032a10 con 0x7f7b2c155200 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b340cf640 1 -- 172.21.15.155:0/3832061433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c155200 msgr2=0x7f7b2c0cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3832061433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c155200 0x7f7b2c0cb8a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009870 tx=0x7f7b2802a3c0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b340cf640 1 -- 172.21.15.155:0/3832061433 shutdown_connections 2024-04-25T13:16:24.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.804+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3832061433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c155200 0x7f7b2c0cb8a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.805+0000 7f7b340cf640 1 -- 172.21.15.155:0/3832061433 >> 172.21.15.155:0/3832061433 conn(0x7f7b2c06f670 msgr2=0x7f7b2c070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:24.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.805+0000 7f7b340cf640 1 -- 172.21.15.155:0/3832061433 shutdown_connections 2024-04-25T13:16:24.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.805+0000 7f7b340cf640 1 -- 172.21.15.155:0/3832061433 wait complete. 2024-04-25T13:16:24.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 Processor -- start 2024-04-25T13:16:24.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 -- start start 2024-04-25T13:16:24.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b2c0c9cd0 0x7f7b2c1f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 0x7f7b2c14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b2c155200 0x7f7b2c1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c1555e0 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0cacb0 con 0x7f7b2c0c9cd0 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b340cf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c155760 con 0x7f7b2c155200 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b3166a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 0x7f7b2c14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b3166a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 0x7f7b2c14fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50696/0 (socket says 172.21.15.155:50696) 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.806+0000 7f7b3166a640 1 -- 172.21.15.155:0/3191825931 learned_addr learned my addr 172.21.15.155:0/3191825931 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b31e6b640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b2c0c9cd0 0x7f7b2c1f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3266c640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b2c155200 0x7f7b2c1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3166a640 1 -- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b2c155200 msgr2=0x7f7b2c1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3166a640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b2c155200 0x7f7b2c1526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3166a640 1 -- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b2c0c9cd0 msgr2=0x7f7b2c1f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3166a640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b2c0c9cd0 0x7f7b2c1f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3166a640 1 -- 172.21.15.155:0/3191825931 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c15c470 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b3166a640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 0x7f7b2c14fe70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c450 tx=0x7f7b1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c017070 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0052d0 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c15c750 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c003830 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.807+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c15e300 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.808+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c06da80 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.808+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b1c01a070 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.809+0000 7f7b227fc640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b1006c920 0x7f7b1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:24.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.809+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f7b1c08b140 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.809+0000 7f7b31e6b640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b1006c920 0x7f7b1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:24.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.809+0000 7f7b31e6b640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b1006c920 0x7f7b1006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b28034000 tx=0x7f7b2802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:24.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.813+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b1c0592e0 con 0x7f7b2c0cbde0 2024-04-25T13:16:24.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:24.991+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f7b2c0c9770 con 0x7f7b2c0cbde0 2024-04-25T13:16:25.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.683+0000 7f7b227fc640 1 -- 172.21.15.155:0/3191825931 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f7b1c058be0 con 0x7f7b2c0cbde0 2024-04-25T13:16:25.683 INFO:teuthology.orchestra.run.smithi155.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b1006c920 msgr2=0x7f7b1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b1006c920 0x7f7b1006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7b28034000 tx=0x7f7b2802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 msgr2=0x7f7b2c14fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 0x7f7b2c14fe70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c450 tx=0x7f7b1c00c910 comp rx=0 tx=0).stop 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 shutdown_connections 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b1006c920 0x7f7b1006ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b2c155200 0x7f7b2c1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b2c0cbde0 0x7f7b2c14fe70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 --2- 172.21.15.155:0/3191825931 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b2c0c9cd0 0x7f7b2c1f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 >> 172.21.15.155:0/3191825931 conn(0x7f7b2c06f670 msgr2=0x7f7b2c070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:25.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 shutdown_connections 2024-04-25T13:16:25.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.686+0000 7f7b340cf640 1 -- 172.21.15.155:0/3191825931 wait complete. 2024-04-25T13:16:25.709 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T13:16:25.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.810+0000 7fbc79544640 1 Processor -- start 2024-04-25T13:16:25.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.810+0000 7fbc79544640 1 -- start start 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc79544640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbc740c8140 0x7fbc740cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc79544640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc7415b270 con 0x7fbc74072c80 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc79544640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc7415b550 con 0x7fbc74144510 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc79544640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbc740c8c00 con 0x7fbc740c8140 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc737fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbc74072c80 0x7fbc7415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44960/0 (socket says 172.21.15.155:44960) 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc737fe640 1 -- 172.21.15.155:0/4107343730 learned_addr learned my addr 172.21.15.155:0/4107343730 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599222645 0 0) 0x7fbc7415b270 con 0x7fbc74072c80 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc5c003520 con 0x7fbc74072c80 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.811+0000 7fbc727fc640 1 --2- 172.21.15.155:0/4107343730 >> v2:172.21.15.191:3300/0 conn(0x7fbc740c8140 0x7fbc740cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3361128266 0 0) 0x7fbc5c003520 con 0x7fbc74072c80 2024-04-25T13:16:25.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 >> v2:172.21.15.191:3300/0 conn(0x7fbc740c8140 msgr2=0x7fbc740cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 --2- 172.21.15.155:0/4107343730 >> v2:172.21.15.191:3300/0 conn(0x7fbc740c8140 0x7fbc740cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 >> v1:172.21.15.191:6789/0 conn(0x7fbc74144510 legacy=0x7fbc74075230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7415b830 con 0x7fbc74072c80 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fbc6c001670 con 0x7fbc74072c80 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 >> v1:172.21.15.155:6789/0 conn(0x7fbc74072c80 legacy=0x7fbc7415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc5c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c004800 0x7fbc5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc5c0051c0 0x7fbc5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00c090 con 0x7fbc5c003a00 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c00c240 con 0x7fbc5c004800 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c00c440 con 0x7fbc5c0051c0 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc5c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc727fc640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c004800 0x7fbc5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc737fe640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc5c0051c0 0x7fbc5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc72ffd640 1 -- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc5c0051c0 msgr2=0x7fbc5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc5c0051c0 0x7fbc5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc72ffd640 1 -- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c004800 msgr2=0x7fbc5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc5c004800 0x7fbc5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc737fe640 1 -- 172.21.15.155:0/4107343730 reap_dead start 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.812+0000 7fbc72ffd640 1 -- 172.21.15.155:0/4107343730 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c003520 con 0x7fbc5c003a00 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc5c003e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001e50 tx=0x7fbc5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2293a8318e49cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64001a70 con 0x7fbc5c003a00 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc64003970 con 0x7fbc5c003a00 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc71ffb640 1 -- 172.21.15.155:0/4107343730 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64003d60 con 0x7fbc5c003a00 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc79544640 1 -- 172.21.15.155:0/4107343730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 msgr2=0x7fbc5c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc79544640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc5c003e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001e50 tx=0x7fbc5c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc79544640 1 -- 172.21.15.155:0/4107343730 shutdown_connections 2024-04-25T13:16:25.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc79544640 1 --2- 172.21.15.155:0/4107343730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc5c003e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.813+0000 7fbc79544640 1 -- 172.21.15.155:0/4107343730 >> 172.21.15.155:0/4107343730 conn(0x7fbc7406e8b0 msgr2=0x7fbc7406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.814+0000 7fbc79544640 1 -- 172.21.15.155:0/4107343730 shutdown_connections 2024-04-25T13:16:25.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.814+0000 7fbc79544640 1 -- 172.21.15.155:0/4107343730 wait complete. 2024-04-25T13:16:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 Processor -- start 2024-04-25T13:16:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 -- start start 2024-04-25T13:16:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc74156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc740cc900 0x7fbc74155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc741562b0 0x7fbc74140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7415be80 con 0x7fbc5c003a00 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbc741448f0 con 0x7fbc740cc900 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.815+0000 7fbc79544640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbc74075230 con 0x7fbc741562b0 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc74156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc74156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50720/0 (socket says 172.21.15.155:50720) 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 -- 172.21.15.155:0/3065655292 learned_addr learned my addr 172.21.15.155:0/3065655292 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc727fc640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc740cc900 0x7fbc74155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc737fe640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc741562b0 0x7fbc74140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 -- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc741562b0 msgr2=0x7fbc74140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc741562b0 0x7fbc74140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 -- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc740cc900 msgr2=0x7fbc74155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc740cc900 0x7fbc74155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 -- 172.21.15.155:0/3065655292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc74156730 con 0x7fbc5c003a00 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc72ffd640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc74156e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001f70 tx=0x7fbc640014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6403f030 con 0x7fbc5c003a00 2024-04-25T13:16:25.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc640050d0 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc741f0c30 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64037040 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.816+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc741f11f0 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.817+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc74068f50 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.818+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc64042070 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.818+0000 7fbc5b7fe640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbc6006c8f0 0x7fbc6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.818+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fbc640ab900 con 0x7fbc5c003a00 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.818+0000 7fbc727fc640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbc6006c8f0 0x7fbc6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:25.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.818+0000 7fbc727fc640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbc6006c8f0 0x7fbc6006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc74156e10 tx=0x7fbc68009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:25.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:25.822+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbc74156730 con 0x7fbc5c003a00 2024-04-25T13:16:26.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.035+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fbc74142b80 con 0x7fbc5c003a00 2024-04-25T13:16:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.689+0000 7fbc5b7fe640 1 -- 172.21.15.155:0/3065655292 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fbc64079aa0 con 0x7fbc5c003a00 2024-04-25T13:16:26.689 INFO:teuthology.orchestra.run.smithi155.stderr:added data pool 4 to fsmap 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbc6006c8f0 msgr2=0x7fbc6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbc6006c8f0 0x7fbc6006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc74156e10 tx=0x7fbc68009190 comp rx=0 tx=0).stop 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 msgr2=0x7fbc74156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc74156e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001f70 tx=0x7fbc640014a0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 shutdown_connections 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbc6006c8f0 0x7fbc6006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbc741562b0 0x7fbc74140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbc740cc900 0x7fbc74155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 --2- 172.21.15.155:0/3065655292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc5c003a00 0x7fbc74156e80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 >> 172.21.15.155:0/3065655292 conn(0x7fbc7406e8b0 msgr2=0x7fbc74141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:26.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 shutdown_connections 2024-04-25T13:16:26.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.691+0000 7fbc79544640 1 -- 172.21.15.155:0/3065655292 wait complete. 2024-04-25T13:16:26.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:26.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.801+0000 7f8a21d7d640 1 Processor -- start 2024-04-25T13:16:26.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.801+0000 7f8a21d7d640 1 -- start start 2024-04-25T13:16:26.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a21d7d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8a1c06bf70 0x7f8a1c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a21d7d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c0c99f0 0x7f8a1c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a21d7d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a1c15bef0 con 0x7f8a1c06bb90 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a21d7d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8a1c15f510 con 0x7f8a1c06bf70 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a21d7d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1c15b650 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1b7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8a1c06bb90 0x7f8a1c15ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:44964/0 (socket says 172.21.15.155:44964) 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1b7fe640 1 -- 172.21.15.155:0/4134814484 learned_addr learned my addr 172.21.15.155:0/4134814484 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1affd640 1 --2- 172.21.15.155:0/4134814484 >> v2:172.21.15.191:3300/0 conn(0x7f8a1c06bf70 0x7f8a1c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1bfff640 1 --2- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c0c99f0 0x7f8a1c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1a7fc640 1 -- 172.21.15.155:0/4134814484 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726879170 0 0) 0x7f8a1c15bef0 con 0x7f8a1c06bb90 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1a7fc640 1 -- 172.21.15.155:0/4134814484 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a04003520 con 0x7f8a1c06bb90 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1a7fc640 1 -- 172.21.15.155:0/4134814484 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1468028581 0 0) 0x7f8a04003520 con 0x7f8a1c06bb90 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1affd640 1 -- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c0c99f0 msgr2=0x7f8a1c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1affd640 1 --2- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c0c99f0 0x7f8a1c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1affd640 1 -- 172.21.15.155:0/4134814484 >> v1:172.21.15.155:6789/0 conn(0x7f8a1c06bb90 legacy=0x7f8a1c15ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.802+0000 7f8a1affd640 1 -- 172.21.15.155:0/4134814484 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c15b930 con 0x7f8a1c06bf70 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.803+0000 7f8a1affd640 1 --2- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c15af70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8a100097a0 tx=0x7f8a1002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=202ee8bf4ea9a885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.803+0000 7f8a1a7fc640 1 -- 172.21.15.155:0/4134814484 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10037070 con 0x7f8a1c06bf70 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.803+0000 7f8a1a7fc640 1 -- 172.21.15.155:0/4134814484 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1002ac30 con 0x7f8a1c06bf70 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.803+0000 7f8a1a7fc640 1 -- 172.21.15.155:0/4134814484 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c001670 con 0x7f8a1c06bf70 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 -- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 msgr2=0x7f8a1c15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c15af70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8a100097a0 tx=0x7f8a1002a1a0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 -- 172.21.15.155:0/4134814484 shutdown_connections 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c0c99f0 0x7f8a1c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/4134814484 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c15af70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 -- 172.21.15.155:0/4134814484 >> 172.21.15.155:0/4134814484 conn(0x7f8a1c074d50 msgr2=0x7f8a1c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 -- 172.21.15.155:0/4134814484 shutdown_connections 2024-04-25T13:16:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.804+0000 7f8a21d7d640 1 -- 172.21.15.155:0/4134814484 wait complete. 2024-04-25T13:16:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.805+0000 7f8a21d7d640 1 Processor -- start 2024-04-25T13:16:26.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.805+0000 7f8a21d7d640 1 -- start start 2024-04-25T13:16:26.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a21d7d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c06bb90 0x7f8a1c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a21d7d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a21d7d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 0x7f8a1c14ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a21d7d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c15e8e0 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a21d7d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c15e600 con 0x7f8a1c06bf70 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a21d7d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1c074560 con 0x7f8a1c06bb90 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 0x7f8a1c14ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 0x7f8a1c14ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50734/0 (socket says 172.21.15.155:50734) 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 -- 172.21.15.155:0/713493282 learned_addr learned my addr 172.21.15.155:0/713493282 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1affd640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1b7fe640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c06bb90 0x7f8a1c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 -- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c06bb90 msgr2=0x7f8a1c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c06bb90 0x7f8a1c159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 -- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 msgr2=0x7f8a1c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 -- 172.21.15.155:0/713493282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c1586d0 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a1bfff640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 0x7f8a1c14ab00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009d30 tx=0x7f8a1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.806+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14018020 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.807+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14014480 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.807+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14014870 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.807+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1c1f0c70 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.807+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1c1f1230 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.807+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1c068e40 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.808+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a14005d10 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.808+0000 7f8a03fff640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8a0806c920 0x7f8a0806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.808+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a1408c7d0 con 0x7f8a1c0c99f0 2024-04-25T13:16:26.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.808+0000 7f8a1b7fe640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8a0806c920 0x7f8a0806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:26.811 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.809+0000 7f8a1b7fe640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8a0806c920 0x7f8a0806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c005880 tx=0x7f8a0c0057f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:26.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:26.812+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a14022070 con 0x7f8a1c0c99f0 2024-04-25T13:16:27.026 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.026+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a1c06cbe0 con 0x7f8a1c0c99f0 2024-04-25T13:16:27.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.027+0000 7f8a03fff640 1 -- 172.21.15.155:0/713493282 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6835 (secure 0 0 0) 0x7f8a14010040 con 0x7f8a1c0c99f0 2024-04-25T13:16:27.027 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:27.027 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:16:26.036645+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T13:16:27.028 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 5 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8a0806c920 msgr2=0x7f8a0806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8a0806c920 0x7f8a0806ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c005880 tx=0x7f8a0c0057f0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 msgr2=0x7f8a1c14ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 0x7f8a1c14ab00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009d30 tx=0x7f8a1400c490 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 shutdown_connections 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a1c0c99f0 0x7f8a1c14ab00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8a1c06bf70 0x7f8a1c1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8a0806c920 0x7f8a0806ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 --2- 172.21.15.155:0/713493282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8a1c06bb90 0x7f8a1c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.029+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 >> 172.21.15.155:0/713493282 conn(0x7f8a1c074d50 msgr2=0x7f8a1c14fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.030+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 shutdown_connections 2024-04-25T13:16:27.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.030+0000 7f8a21d7d640 1 -- 172.21.15.155:0/713493282 wait complete. 2024-04-25T13:16:27.040 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:27.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.137+0000 7f68e7610640 1 Processor -- start 2024-04-25T13:16:27.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e7610640 1 -- start start 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e7610640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68e00b3c00 0x7f68e00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e7610640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f68e00b5450 0x7f68e00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e7610640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e01558c0 con 0x7f68e01554e0 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e7610640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f68e00b4a80 con 0x7f68e00b3c00 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e7610640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f68e00cb8c0 con 0x7f68e00b5450 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e4bab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68e00b3c00 0x7f68e00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e4bab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68e00b3c00 0x7f68e00b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50748/0 (socket says 172.21.15.155:50748) 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.138+0000 7f68e4bab640 1 -- 172.21.15.155:0/1751374519 learned_addr learned my addr 172.21.15.155:0/1751374519 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:27.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68e4bab640 1 -- 172.21.15.155:0/1751374519 >> v2:172.21.15.191:3300/0 conn(0x7f68e00b5450 msgr2=0x7f68e00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:27.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68e4bab640 1 --2- 172.21.15.155:0/1751374519 >> v2:172.21.15.191:3300/0 conn(0x7f68e00b5450 0x7f68e00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68e4bab640 1 -- 172.21.15.155:0/1751374519 >> v1:172.21.15.191:6789/0 conn(0x7f68e01554e0 legacy=0x7f68e015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:27.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68e4bab640 1 -- 172.21.15.155:0/1751374519 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e00cbba0 con 0x7f68e00b3c00 2024-04-25T13:16:27.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68e4bab640 1 --2- 172.21.15.155:0/1751374519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00b4f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68e00ce7e0 tx=0x7f68d402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadabca1d1c4ee38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68dffff640 1 -- 172.21.15.155:0/1751374519 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4037070 con 0x7f68e00b3c00 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68dffff640 1 -- 172.21.15.155:0/1751374519 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d4032440 con 0x7f68e00b3c00 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.139+0000 7f68dffff640 1 -- 172.21.15.155:0/1751374519 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4032810 con 0x7f68e00b3c00 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 -- 172.21.15.155:0/1751374519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 msgr2=0x7f68e00b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 --2- 172.21.15.155:0/1751374519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00b4f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f68e00ce7e0 tx=0x7f68d402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 -- 172.21.15.155:0/1751374519 shutdown_connections 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 --2- 172.21.15.155:0/1751374519 >> v2:172.21.15.191:3300/0 conn(0x7f68e00b5450 0x7f68e00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 --2- 172.21.15.155:0/1751374519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00b4f10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 -- 172.21.15.155:0/1751374519 >> 172.21.15.155:0/1751374519 conn(0x7f68e0074d50 msgr2=0x7f68e0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 -- 172.21.15.155:0/1751374519 shutdown_connections 2024-04-25T13:16:27.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.140+0000 7f68e7610640 1 -- 172.21.15.155:0/1751374519 wait complete. 2024-04-25T13:16:27.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.141+0000 7f68e7610640 1 Processor -- start 2024-04-25T13:16:27.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.141+0000 7f68e7610640 1 -- start start 2024-04-25T13:16:27.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e7610640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e7610640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68e00b5450 0x7f68e015e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e7610640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01554e0 0x7f68e015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e7610640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68e00b4710 con 0x7f68e00b3c00 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e7610640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f68e00b4430 con 0x7f68e01554e0 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e7610640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f68e00b3580 con 0x7f68e00b5450 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50758/0 (socket says 172.21.15.155:50758) 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 -- 172.21.15.155:0/2581180216 learned_addr learned my addr 172.21.15.155:0/2581180216 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e5bad640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01554e0 0x7f68e015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e4bab640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68e00b5450 0x7f68e015e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 -- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68e00b5450 msgr2=0x7f68e015e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68e00b5450 0x7f68e015e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 -- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01554e0 msgr2=0x7f68e015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.145 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01554e0 0x7f68e015e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 -- 172.21.15.155:0/2581180216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e01f1690 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.142+0000 7f68e53ac640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00c63b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c7a0 tx=0x7f68d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.143+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8017070 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.143+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d8003da0 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.143+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e01f1970 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.143+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d80052b0 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.143+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e01f1f30 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.144+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e00b5240 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.144+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f68d801a070 con 0x7f68e00b3c00 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.145+0000 7f68ddffb640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f68cc06c8f0 0x7f68cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.145+0000 7f68e4bab640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f68cc06c8f0 0x7f68cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.145+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68d808b510 con 0x7f68e00b3c00 2024-04-25T13:16:27.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.145+0000 7f68e4bab640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f68cc06c8f0 0x7f68cc06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f68d4034000 tx=0x7f68d402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.149+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f68e00b5240 con 0x7f68e00b3c00 2024-04-25T13:16:27.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.327+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68e0068e40 con 0x7f68e00b3c00 2024-04-25T13:16:27.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.328+0000 7f68ddffb640 1 -- 172.21.15.155:0/2581180216 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7f68d8059690 con 0x7f68e00b3c00 2024-04-25T13:16:27.328 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:27.328 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:27.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f68cc06c8f0 msgr2=0x7f68cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f68cc06c8f0 0x7f68cc06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f68d4034000 tx=0x7f68d402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 msgr2=0x7f68e00c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00c63b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c7a0 tx=0x7f68d800cc60 comp rx=0 tx=0).stop 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 shutdown_connections 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68e01554e0 0x7f68e015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f68cc06c8f0 0x7f68cc06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f68e00b5450 0x7f68e015e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 --2- 172.21.15.155:0/2581180216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68e00b3c00 0x7f68e00c63b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 >> 172.21.15.155:0/2581180216 conn(0x7f68e0074d50 msgr2=0x7f68e00cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 shutdown_connections 2024-04-25T13:16:27.331 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.330+0000 7f68e7610640 1 -- 172.21.15.155:0/2581180216 wait complete. 2024-04-25T13:16:27.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:27.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.437+0000 7f4f5408a640 1 Processor -- start 2024-04-25T13:16:27.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.437+0000 7f4f5408a640 1 -- start start 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f5408a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4f4c06bb90 0x7f4f4c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f5408a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f4c06bf70 0x7f4f4c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f5408a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c15bef0 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f5408a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c15b650 con 0x7f4f4c06bf70 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f5408a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c15b930 con 0x7f4f4c06bb90 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f4c06bf70 0x7f4f4c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f4c06bf70 0x7f4f4c15ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50762/0 (socket says 172.21.15.155:50762) 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 -- 172.21.15.155:0/937344666 learned_addr learned my addr 172.21.15.155:0/937344666 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:27.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51e26640 1 --2- 172.21.15.155:0/937344666 >> v2:172.21.15.191:3300/0 conn(0x7f4f4c06bb90 0x7f4f4c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 -- 172.21.15.155:0/937344666 >> v2:172.21.15.191:3300/0 conn(0x7f4f4c06bb90 msgr2=0x7f4f4c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 --2- 172.21.15.155:0/937344666 >> v2:172.21.15.191:3300/0 conn(0x7f4f4c06bb90 0x7f4f4c15af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 -- 172.21.15.155:0/937344666 >> v1:172.21.15.191:6789/0 conn(0x7f4f4c0c99f0 legacy=0x7f4f4c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.438+0000 7f4f51625640 1 -- 172.21.15.155:0/937344666 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c15bc10 con 0x7f4f4c06bf70 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.439+0000 7f4f51625640 1 --2- 172.21.15.155:0/937344666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c15ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c06db00 tx=0x7f4f3c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6725f4923d49e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.439+0000 7f4f50e24640 1 -- 172.21.15.155:0/937344666 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c037070 con 0x7f4f4c06bf70 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.439+0000 7f4f50e24640 1 -- 172.21.15.155:0/937344666 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c032440 con 0x7f4f4c06bf70 2024-04-25T13:16:27.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.439+0000 7f4f50e24640 1 -- 172.21.15.155:0/937344666 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c032810 con 0x7f4f4c06bf70 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 -- 172.21.15.155:0/937344666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06bf70 msgr2=0x7f4f4c15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 --2- 172.21.15.155:0/937344666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c15ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c06db00 tx=0x7f4f3c02a2c0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 -- 172.21.15.155:0/937344666 shutdown_connections 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 --2- 172.21.15.155:0/937344666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c15ee00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 --2- 172.21.15.155:0/937344666 >> v2:172.21.15.191:3300/0 conn(0x7f4f4c06bb90 0x7f4f4c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 -- 172.21.15.155:0/937344666 >> 172.21.15.155:0/937344666 conn(0x7f4f4c074d50 msgr2=0x7f4f4c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 -- 172.21.15.155:0/937344666 shutdown_connections 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.440+0000 7f4f5408a640 1 -- 172.21.15.155:0/937344666 wait complete. 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.441+0000 7f4f5408a640 1 Processor -- start 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.441+0000 7f4f5408a640 1 -- start start 2024-04-25T13:16:27.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.441+0000 7f4f5408a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f4c06bb90 0x7f4f4c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.441+0000 7f4f5408a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c1f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.441+0000 7f4f5408a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 0x7f4f4c1f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f5408a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c074560 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f5408a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c15e8e0 con 0x7f4f4c06bf70 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f5408a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c15f340 con 0x7f4f4c06bb90 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 0x7f4f4c1f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 0x7f4f4c1f4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50764/0 (socket says 172.21.15.155:50764) 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 -- 172.21.15.155:0/1890172361 learned_addr learned my addr 172.21.15.155:0/1890172361 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f51625640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c1f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f51e26640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f4c06bb90 0x7f4f4c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 -- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f4c06bb90 msgr2=0x7f4f4c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f4c06bb90 0x7f4f4c1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 -- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f4c06bf70 msgr2=0x7f4f4c1f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c1f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 -- 172.21.15.155:0/1890172361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c1f4f90 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f52627640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 0x7f4f4c1f4a50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400c780 tx=0x7f4f4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44004b60 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f44004d00 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400aa90 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c15aa80 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.442+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c15a4c0 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.443+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c0cbd60 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.444+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f4400ac30 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.444+0000 7f4f427fc640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f3006c8f0 0x7f4f3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.444+0000 7f4f51e26640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f3006c8f0 0x7f4f3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.444+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f4408c150 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.445+0000 7f4f51e26640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f3006c8f0 0x7f4f3006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f48006fd0 tx=0x7f4f48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.449+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f4c0cbd60 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.630+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f4c151080 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.631+0000 7f4f427fc640 1 -- 172.21.15.155:0/1890172361 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7f4f44020070 con 0x7f4f4c0c99f0 2024-04-25T13:16:27.631 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:27.631 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:27.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f3006c8f0 msgr2=0x7f4f3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f3006c8f0 0x7f4f3006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f48006fd0 tx=0x7f4f48008040 comp rx=0 tx=0).stop 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 msgr2=0x7f4f4c1f4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 0x7f4f4c1f4a50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400c780 tx=0x7f4f4400cc40 comp rx=0 tx=0).stop 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 shutdown_connections 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c0c99f0 0x7f4f4c1f4a50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4f4c06bf70 0x7f4f4c1f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4f3006c8f0 0x7f4f3006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 --2- 172.21.15.155:0/1890172361 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4f4c06bb90 0x7f4f4c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 >> 172.21.15.155:0/1890172361 conn(0x7f4f4c074d50 msgr2=0x7f4f4c14f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 shutdown_connections 2024-04-25T13:16:27.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.633+0000 7f4f5408a640 1 -- 172.21.15.155:0/1890172361 wait complete. 2024-04-25T13:16:27.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:27.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.756+0000 7f5faeb08640 1 Processor -- start 2024-04-25T13:16:27.756 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.756+0000 7f5faeb08640 1 -- start start 2024-04-25T13:16:27.757 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5faeb08640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5faeb08640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5fa806bf70 0x7f5fa815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5faeb08640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa815bef0 con 0x7f5fa80c99f0 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5faeb08640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa815b650 con 0x7f5fa806bf70 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5faeb08640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa815b930 con 0x7f5fa806bb90 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa7fff640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5fa806bf70 0x7f5fa815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fac8a4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fad0a5640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f5fa80c99f0 0x7f5fa8154db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:41672/0 (socket says 172.21.15.155:41672) 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa7fff640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5fa806bf70 0x7f5fa815ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:47082/0 (socket says 172.21.15.155:47082) 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fad0a5640 1 -- 172.21.15.155:0/2650179589 learned_addr learned my addr 172.21.15.155:0/2650179589 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fac8a4640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:49888/0 (socket says 172.21.15.155:49888) 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa7fff640 1 -- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 msgr2=0x7f5fa815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa7fff640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.758 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa7fff640 1 -- 172.21.15.155:0/2650179589 >> v1:172.21.15.191:6789/0 conn(0x7f5fa80c99f0 legacy=0x7f5fa8154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa7fff640 1 -- 172.21.15.155:0/2650179589 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa815bc10 con 0x7f5fa806bf70 2024-04-25T13:16:27.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fa77fe640 1 -- 172.21.15.155:0/2650179589 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714686628 0 0) 0x7f5fa815bef0 con 0x7f5fa80c99f0 2024-04-25T13:16:27.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.757+0000 7f5fac8a4640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:27.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.758+0000 7f5fa7fff640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa815ee00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097a0 tx=0x7f5f9402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fbc8e2f49441c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.758+0000 7f5fa77fe640 1 -- 172.21.15.155:0/2650179589 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94037070 con 0x7f5fa806bf70 2024-04-25T13:16:27.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.758+0000 7f5fa77fe640 1 -- 172.21.15.155:0/2650179589 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f94032440 con 0x7f5fa806bf70 2024-04-25T13:16:27.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.758+0000 7f5fa77fe640 1 -- 172.21.15.155:0/2650179589 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94032810 con 0x7f5fa806bf70 2024-04-25T13:16:27.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 -- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 msgr2=0x7f5fa815ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa815ee00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097a0 tx=0x7f5f9402a210 comp rx=0 tx=0).stop 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 -- 172.21.15.155:0/2650179589 shutdown_connections 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa815ee00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 --2- 172.21.15.155:0/2650179589 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 -- 172.21.15.155:0/2650179589 >> 172.21.15.155:0/2650179589 conn(0x7f5fa8074d50 msgr2=0x7f5fa8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 -- 172.21.15.155:0/2650179589 shutdown_connections 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.759+0000 7f5faeb08640 1 -- 172.21.15.155:0/2650179589 wait complete. 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.760+0000 7f5faeb08640 1 Processor -- start 2024-04-25T13:16:27.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.760+0000 7f5faeb08640 1 -- start start 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5faeb08640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5faeb08640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5faeb08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 0x7f5fa814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5faeb08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8074560 con 0x7f5fa80c99f0 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5faeb08640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa815e8e0 con 0x7f5fa806bf70 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5faeb08640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa815f340 con 0x7f5fa806bb90 2024-04-25T13:16:27.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 0x7f5fa814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 0x7f5fa814ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50780/0 (socket says 172.21.15.155:50780) 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 -- 172.21.15.155:0/3575544206 learned_addr learned my addr 172.21.15.155:0/3575544206 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fa7fff640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fac8a4640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 -- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 msgr2=0x7f5fa814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa814ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 -- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 msgr2=0x7f5fa814c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa814c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 -- 172.21.15.155:0/3575544206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa81f0950 con 0x7f5fa80c99f0 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fa7fff640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.761+0000 7f5fad0a5640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 0x7f5fa814ce20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c700 tx=0x7f5fa000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.762+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0018070 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.762+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa000ce10 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.762+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000a860 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.762+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa81f0c30 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.762+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa81f11f0 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.763+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa8068e40 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.763+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fa001b070 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.763+0000 7f5fa57fa640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5f8c06c920 0x7f5f8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.764+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5fa008b270 con 0x7f5fa80c99f0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.764+0000 7f5fac8a4640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5f8c06c920 0x7f5f8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:27.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.764+0000 7f5fac8a4640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5f8c06c920 0x7f5f8c06ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009560 tx=0x7f5f9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:27.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.768+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fa0058da0 con 0x7f5fa80c99f0 2024-04-25T13:16:27.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.982+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fa80cb510 con 0x7f5fa80c99f0 2024-04-25T13:16:27.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.983+0000 7f5fa57fa640 1 -- 172.21.15.155:0/3575544206 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6840 (secure 0 0 0) 0x7f5fa005d0a0 con 0x7f5fa80c99f0 2024-04-25T13:16:27.983 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:27.983 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:16:27.263306+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-25T13:16:27.983 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 6 2024-04-25T13:16:27.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5f8c06c920 msgr2=0x7f5f8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5f8c06c920 0x7f5f8c06ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009560 tx=0x7f5f9c009190 comp rx=0 tx=0).stop 2024-04-25T13:16:27.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 msgr2=0x7f5fa814ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:27.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 0x7f5fa814ce20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c700 tx=0x7f5fa000cbc0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 shutdown_connections 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa80c99f0 0x7f5fa814ce20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5fa806bf70 0x7f5fa814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5f8c06c920 0x7f5f8c06ede0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 --2- 172.21.15.155:0/3575544206 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5fa806bb90 0x7f5fa814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 >> 172.21.15.155:0/3575544206 conn(0x7f5fa8074d50 msgr2=0x7f5fa80ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 shutdown_connections 2024-04-25T13:16:27.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:27.985+0000 7f5faeb08640 1 -- 172.21.15.155:0/3575544206 wait complete. 2024-04-25T13:16:27.996 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:28.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.092+0000 7fce39a20640 1 Processor -- start 2024-04-25T13:16:28.092 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.092+0000 7fce39a20640 1 -- start start 2024-04-25T13:16:28.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce39a20640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce341554e0 0x7fce3415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce39a20640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fce340b3c00 0x7fce340b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce39a20640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b5450 0x7fce340d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce39a20640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fce340b4a80 con 0x7fce341554e0 2024-04-25T13:16:28.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce39a20640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fce341558c0 con 0x7fce340b3c00 2024-04-25T13:16:28.095 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce39a20640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fce3415f630 con 0x7fce340b5450 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce341554e0 0x7fce3415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fce341554e0 0x7fce3415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50784/0 (socket says 172.21.15.155:50784) 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 -- 172.21.15.155:0/3343243445 learned_addr learned my addr 172.21.15.155:0/3343243445 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce327fc640 1 --2- 172.21.15.155:0/3343243445 >> v2:172.21.15.191:3300/0 conn(0x7fce340b3c00 0x7fce340b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce337fe640 1 --2- 172.21.15.155:0/3343243445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b5450 0x7fce340d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 -- 172.21.15.155:0/3343243445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b5450 msgr2=0x7fce340d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 --2- 172.21.15.155:0/3343243445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b5450 0x7fce340d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.096 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 -- 172.21.15.155:0/3343243445 >> v2:172.21.15.191:3300/0 conn(0x7fce340b3c00 msgr2=0x7fce340b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 --2- 172.21.15.155:0/3343243445 >> v2:172.21.15.191:3300/0 conn(0x7fce340b3c00 0x7fce340b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.093+0000 7fce32ffd640 1 -- 172.21.15.155:0/3343243445 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce340cb8c0 con 0x7fce341554e0 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.094+0000 7fce32ffd640 1 --2- 172.21.15.155:0/3343243445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce341554e0 0x7fce3415f0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fce340ce7e0 tx=0x7fce2402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedd29e65862e7b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.094+0000 7fce31ffb640 1 -- 172.21.15.155:0/3343243445 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24036070 con 0x7fce341554e0 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.094+0000 7fce31ffb640 1 -- 172.21.15.155:0/3343243445 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce24031600 con 0x7fce341554e0 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.094+0000 7fce31ffb640 1 -- 172.21.15.155:0/3343243445 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240319d0 con 0x7fce341554e0 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 -- 172.21.15.155:0/3343243445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce341554e0 msgr2=0x7fce3415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 --2- 172.21.15.155:0/3343243445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce341554e0 0x7fce3415f0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fce340ce7e0 tx=0x7fce2402a730 comp rx=0 tx=0).stop 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 -- 172.21.15.155:0/3343243445 shutdown_connections 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 --2- 172.21.15.155:0/3343243445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b5450 0x7fce340d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 --2- 172.21.15.155:0/3343243445 >> v2:172.21.15.191:3300/0 conn(0x7fce340b3c00 0x7fce340b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 --2- 172.21.15.155:0/3343243445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce341554e0 0x7fce3415f0f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 -- 172.21.15.155:0/3343243445 >> 172.21.15.155:0/3343243445 conn(0x7fce34074d50 msgr2=0x7fce34075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 -- 172.21.15.155:0/3343243445 shutdown_connections 2024-04-25T13:16:28.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.095+0000 7fce39a20640 1 -- 172.21.15.155:0/3343243445 wait complete. 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.096+0000 7fce39a20640 1 Processor -- start 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.096+0000 7fce39a20640 1 -- start start 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce39a20640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b3c00 0x7fce3415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce39a20640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 0x7fce34155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce39a20640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce341554e0 0x7fce340c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce39a20640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce340b4430 con 0x7fce340b5450 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce39a20640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fce340b4150 con 0x7fce341554e0 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce39a20640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fce340b4710 con 0x7fce340b3c00 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 0x7fce34155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 0x7fce34155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50796/0 (socket says 172.21.15.155:50796) 2024-04-25T13:16:28.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 -- 172.21.15.155:0/218137136 learned_addr learned my addr 172.21.15.155:0/218137136 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce32ffd640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b3c00 0x7fce3415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce337fe640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce341554e0 0x7fce340c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 -- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b3c00 msgr2=0x7fce3415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b3c00 0x7fce3415ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 -- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce341554e0 msgr2=0x7fce340c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce341554e0 0x7fce340c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 -- 172.21.15.155:0/218137136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce34156350 con 0x7fce340b5450 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce337fe640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce341554e0 0x7fce340c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce32ffd640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b3c00 0x7fce3415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce327fc640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 0x7fce34155aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce2800e870 tx=0x7fce2800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.097+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28017070 con 0x7fce340b5450 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.098+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2800ee60 con 0x7fce340b5450 2024-04-25T13:16:28.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.098+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce340c9c20 con 0x7fce340b5450 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.098+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2800cb80 con 0x7fce340b5450 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.098+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce340ca1e0 con 0x7fce340b5450 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.098+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce34068e40 con 0x7fce340b5450 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.099+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce2801a070 con 0x7fce340b5450 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.099+0000 7fce1bfff640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fce2006c8f0 0x7fce2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.099+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fce2808bfd0 con 0x7fce340b5450 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.099+0000 7fce32ffd640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fce2006c8f0 0x7fce2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:28.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.100+0000 7fce32ffd640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fce2006c8f0 0x7fce2006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce24033000 tx=0x7fce24009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:28.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.104+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fce2805a150 con 0x7fce340b5450 2024-04-25T13:16:28.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.280+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce340cd3e0 con 0x7fce340b5450 2024-04-25T13:16:28.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.281+0000 7fce1bfff640 1 -- 172.21.15.155:0/218137136 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7fce28059a50 con 0x7fce340b5450 2024-04-25T13:16:28.281 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:28.281 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:28.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fce2006c8f0 msgr2=0x7fce2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fce2006c8f0 0x7fce2006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fce24033000 tx=0x7fce24009000 comp rx=0 tx=0).stop 2024-04-25T13:16:28.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 msgr2=0x7fce34155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 0x7fce34155aa0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fce2800e870 tx=0x7fce2800ed30 comp rx=0 tx=0).stop 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 shutdown_connections 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fce341554e0 0x7fce340c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340b5450 0x7fce34155aa0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fce2006c8f0 0x7fce2006edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 --2- 172.21.15.155:0/218137136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fce340b3c00 0x7fce3415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 >> 172.21.15.155:0/218137136 conn(0x7fce34074d50 msgr2=0x7fce341535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 shutdown_connections 2024-04-25T13:16:28.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:28.283+0000 7fce39a20640 1 -- 172.21.15.155:0/218137136 wait complete. 2024-04-25T13:16:28.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:20.990091+0000', 'modified': '2024-04-25T13:16:27.263306+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.191:6837/2351082662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6835', 'nonce': 2351082662}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2351082662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4305, 'qdb_cluster': [4305]} 2024-04-25T13:16:28.899 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:16:28.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:16:29.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.002+0000 7fc55422a640 1 Processor -- start 2024-04-25T13:16:29.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.002+0000 7fc55422a640 1 -- start start 2024-04-25T13:16:29.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc55422a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 0x7fc54c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc55422a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc54c15f220 0x7fc54c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc55422a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc54c06d540 con 0x7fc54c155230 2024-04-25T13:16:29.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc55422a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc54c0c9a80 con 0x7fc54c15f220 2024-04-25T13:16:29.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc55422a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c15b4c0 con 0x7fc54c15b030 2024-04-25T13:16:29.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc5517c5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 0x7fc54c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc5517c5640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 0x7fc54c15ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:49924/0 (socket says 172.21.15.155:49924) 2024-04-25T13:16:29.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc5517c5640 1 -- 172.21.15.155:0/1600374366 learned_addr learned my addr 172.21.15.155:0/1600374366 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.003+0000 7fc5527c7640 1 --2- 172.21.15.155:0/1600374366 >> v2:172.21.15.191:3300/0 conn(0x7fc54c15f220 0x7fc54c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.004+0000 7fc5517c5640 1 -- 172.21.15.155:0/1600374366 >> v2:172.21.15.191:3300/0 conn(0x7fc54c15f220 msgr2=0x7fc54c0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.004+0000 7fc5517c5640 1 --2- 172.21.15.155:0/1600374366 >> v2:172.21.15.191:3300/0 conn(0x7fc54c15f220 0x7fc54c0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.004+0000 7fc5517c5640 1 -- 172.21.15.155:0/1600374366 >> v1:172.21.15.191:6789/0 conn(0x7fc54c155230 legacy=0x7fc54c071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.004+0000 7fc5517c5640 1 -- 172.21.15.155:0/1600374366 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c15b7a0 con 0x7fc54c15b030 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.004+0000 7fc5527c7640 1 --2- 172.21.15.155:0/1600374366 >> v2:172.21.15.191:3300/0 conn(0x7fc54c15f220 0x7fc54c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.004+0000 7fc5517c5640 1 --2- 172.21.15.155:0/1600374366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 0x7fc54c15ece0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009870 tx=0x7fc53c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f9aa1e0a38b0b3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc550fc4640 1 -- 172.21.15.155:0/1600374366 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c037070 con 0x7fc54c15b030 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc550fc4640 1 -- 172.21.15.155:0/1600374366 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c032440 con 0x7fc54c15b030 2024-04-25T13:16:29.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc550fc4640 1 -- 172.21.15.155:0/1600374366 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c032810 con 0x7fc54c15b030 2024-04-25T13:16:29.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 -- 172.21.15.155:0/1600374366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 msgr2=0x7fc54c15ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 --2- 172.21.15.155:0/1600374366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 0x7fc54c15ece0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009870 tx=0x7fc53c02a270 comp rx=0 tx=0).stop 2024-04-25T13:16:29.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 -- 172.21.15.155:0/1600374366 shutdown_connections 2024-04-25T13:16:29.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 --2- 172.21.15.155:0/1600374366 >> v2:172.21.15.191:3300/0 conn(0x7fc54c15f220 0x7fc54c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 --2- 172.21.15.155:0/1600374366 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c15b030 0x7fc54c15ece0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 -- 172.21.15.155:0/1600374366 >> 172.21.15.155:0/1600374366 conn(0x7fc54c074f30 msgr2=0x7fc54c075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 -- 172.21.15.155:0/1600374366 shutdown_connections 2024-04-25T13:16:29.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.005+0000 7fc55422a640 1 -- 172.21.15.155:0/1600374366 wait complete. 2024-04-25T13:16:29.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.006+0000 7fc55422a640 1 Processor -- start 2024-04-25T13:16:29.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.006+0000 7fc55422a640 1 -- start start 2024-04-25T13:16:29.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc55422a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54c155230 0x7fc54c1f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc55422a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 0x7fc54c15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc55422a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c0cdf80 0x7fc54c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc55422a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c15e7c0 con 0x7fc54c15f220 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc55422a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c15bd60 con 0x7fc54c155230 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc55422a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c155610 con 0x7fc54c0cdf80 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc5517c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 0x7fc54c15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc5517c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 0x7fc54c15d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50812/0 (socket says 172.21.15.155:50812) 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc5517c5640 1 -- 172.21.15.155:0/1293790992 learned_addr learned my addr 172.21.15.155:0/1293790992 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc5527c7640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c0cdf80 0x7fc54c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.007+0000 7fc551fc6640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54c155230 0x7fc54c1f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5517c5640 1 -- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c0cdf80 msgr2=0x7fc54c0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5517c5640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c0cdf80 0x7fc54c0ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5517c5640 1 -- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54c155230 msgr2=0x7fc54c1f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5517c5640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54c155230 0x7fc54c1f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5517c5640 1 -- 172.21.15.155:0/1293790992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c1e61d0 con 0x7fc54c15f220 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5517c5640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 0x7fc54c15d230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc53c000c00 tx=0x7fc53c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5427fc640 1 -- 172.21.15.155:0/1293790992 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c037040 con 0x7fc54c15f220 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5427fc640 1 -- 172.21.15.155:0/1293790992 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c042070 con 0x7fc54c15f220 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c1e6470 con 0x7fc54c15f220 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc5427fc640 1 -- 172.21.15.155:0/1293790992 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c030880 con 0x7fc54c15f220 2024-04-25T13:16:29.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.008+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1e6a10 con 0x7fc54c15f220 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.009+0000 7fc5427fc640 1 -- 172.21.15.155:0/1293790992 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc53c030a20 con 0x7fc54c15f220 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.010+0000 7fc5427fc640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.010+0000 7fc5427fc640 1 -- 172.21.15.155:0/1293790992 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc53c0ac4f0 con 0x7fc54c15f220 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.010+0000 7fc551fc6640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.010+0000 7fc551fc6640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53006c8f0 0x7fc53006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5480012e0 tx=0x7fc548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.011+0000 7fc55701c740 1 Processor -- start 2024-04-25T13:16:29.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.011+0000 7fc55701c740 1 -- start start 2024-04-25T13:16:29.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc55701c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 0x55835b81ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7d9fc0 0x55835b7ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7daa70 0x55835b8288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc55701c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55835b743c50 con 0x55835b7da690 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55835b6e0830 con 0x55835b7daa70 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55835b73fc10 con 0x55835b7d9fc0 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 0x55835b81ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 0x55835b81ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50820/0 (socket says 172.21.15.155:50820) 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 -- 172.21.15.155:0/1037854641 learned_addr learned my addr 172.21.15.155:0/1037854641 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc5517c5640 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7d9fc0 0x55835b7ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc5527c7640 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7daa70 0x55835b8288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 -- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7d9fc0 msgr2=0x55835b7ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7d9fc0 0x55835b7ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 -- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7daa70 msgr2=0x55835b8288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7daa70 0x55835b8288a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 -- 172.21.15.155:0/1037854641 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835b4562d0 con 0x55835b7da690 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc551fc6640 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 0x55835b81ea90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc54800fe40 tx=0x7fc548012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff581155e05b326 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc52f7fe640 1 -- 172.21.15.155:0/1037854641 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548025070 con 0x55835b7da690 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc52f7fe640 1 -- 172.21.15.155:0/1037854641 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54801b050 con 0x55835b7da690 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.012+0000 7fc52f7fe640 1 -- 172.21.15.155:0/1037854641 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5480137c0 con 0x55835b7da690 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 -- 172.21.15.155:0/1037854641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 msgr2=0x55835b81ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 0x55835b81ea90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc54800fe40 tx=0x7fc548012000 comp rx=0 tx=0).stop 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 -- 172.21.15.155:0/1037854641 shutdown_connections 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7daa70 0x55835b8288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7d9fc0 0x55835b7ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 --2- 172.21.15.155:0/1037854641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7da690 0x55835b81ea90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 -- 172.21.15.155:0/1037854641 >> 172.21.15.155:0/1037854641 conn(0x55835b7dbc80 msgr2=0x55835b7de580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 -- 172.21.15.155:0/1037854641 shutdown_connections 2024-04-25T13:16:29.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 -- 172.21.15.155:0/1037854641 wait complete. 2024-04-25T13:16:29.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.013+0000 7fc55701c740 1 -- start start 2024-04-25T13:16:29.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 Processor -- start 2024-04-25T13:16:29.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 0x55835b801300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b8338f0 0x55835b805600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55835b81f700 con 0x55835b7daa70 2024-04-25T13:16:29.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55835b6de470 con 0x55835b7da690 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55835b7dd0e0 con 0x55835b8338f0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc55701c740 10 client.0 _ll_register_callbacks cb 0x55835b703f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.014+0000 7fc5517c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 0x55835b801300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 0x55835b801300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50826/0 (socket says 172.21.15.155:50826) 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 -- 172.21.15.155:0/3540792999 learned_addr learned my addr 172.21.15.155:0/3540792999 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5527c7640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b8338f0 0x55835b805600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc551fc6640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 -- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b8338f0 msgr2=0x55835b805600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b8338f0 0x55835b805600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 -- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 msgr2=0x55835b821ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 -- 172.21.15.155:0/3540792999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835b5206b0 con 0x55835b7daa70 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc5517c5640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 0x55835b801300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc53c02a2b0 tx=0x7fc53c032440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589a0b1cf0386edd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc52cff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:16:29.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc52cff9640 1 -- 172.21.15.155:0/3540792999 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c082b50 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc52cff9640 1 -- 172.21.15.155:0/3540792999 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc53c0826c0 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc54801b050 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc52cff9640 1 -- 172.21.15.155:0/3540792999 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc53c0828c0 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc55701c740 10 client.4428 fetch_fsmap learned FSMap version 6 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55835b823510 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc52cff9640 1 -- 172.21.15.155:0/3540792999 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54801b050 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc52cff9640 1 -- 172.21.15.155:0/3540792999 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fc53c03a070 con 0x55835b7daa70 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.015+0000 7fc55701c740 10 client.4428 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc55701c740 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc55701c740 20 client.4428 populate_metadata read hostname 'smithi155' 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc55701c740 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b7fef50 0x55835b83f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc55701c740 4 client.4428 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 --> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55835b751670 con 0x55835b7fef50 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc551fc6640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b7fef50 0x55835b83f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc551fc6640 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b7fef50 0x55835b83f4d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b5309bfc408e26 server_cookie=3426ba59648e632a in_seq=0 out_seq=0 2024-04-25T13:16:29.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:29.016+0000 7fc52cff9640 10 client.4428 ms_handle_connect on v2:172.21.15.191:6835/2351082662 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc52cff9640 1 -- 172.21.15.155:0/3540792999 <== mds.0 v2:172.21.15.191:6835/2351082662 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55835b751670 con 0x55835b7fef50 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc52cff9640 10 client.4428 handle_command_reply: tid=0 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 client.4428 shutdown 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 msgr2=0x55835b801300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 0x55835b801300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc53c02a2b0 tx=0x7fc53c032440 comp rx=0 tx=0).stop 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 shutdown_connections 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b7fef50 0x55835b83f4d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b8338f0 0x55835b805600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b7daa70 0x55835b801300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 --2- 172.21.15.155:0/3540792999 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc52cff9640 0 client.4428 ms_handle_reset on v2:172.21.15.191:6835/2351082662 2024-04-25T13:16:32.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 >> 172.21.15.155:0/3540792999 conn(0x55835b7d9fc0 msgr2=0x55835b7d91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:32.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 shutdown_connections 2024-04-25T13:16:32.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.266+0000 7fc55701c740 1 -- 172.21.15.155:0/3540792999 wait complete. 2024-04-25T13:16:32.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.267+0000 7fc55701c740 20 client.4428 trim_cache size 0 max 16384 2024-04-25T13:16:32.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.286+0000 7fc55701c740 1 Processor -- start 2024-04-25T13:16:32.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.286+0000 7fc55701c740 1 -- start start 2024-04-25T13:16:32.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.286+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.286+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b8448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.286+0000 7fc55701c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b844e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc55701c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1fd440 con 0x55835b8338f0 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c1fda90 con 0x55835b7da690 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55835b823d70 con 0x55835b7daa70 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b844e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b844e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50828/0 (socket says 172.21.15.155:50828) 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 -- 172.21.15.155:0/58465492 learned_addr learned my addr 172.21.15.155:0/58465492 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc551fc6640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5517c5640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b8448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 -- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 msgr2=0x55835b8448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b8448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 -- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 msgr2=0x55835b821800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 -- 172.21.15.155:0/58465492 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835b800260 con 0x55835b8338f0 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc551fc6640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5517c5640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b8448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc5527c7640 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b844e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc544009c30 tx=0x7fc544009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69516aea1b4059ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc52effd640 1 -- 172.21.15.155:0/58465492 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544020470 con 0x55835b8338f0 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.287+0000 7fc52effd640 1 -- 172.21.15.155:0/58465492 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54401b070 con 0x55835b8338f0 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc52effd640 1 -- 172.21.15.155:0/58465492 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544020870 con 0x55835b8338f0 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 -- 172.21.15.155:0/58465492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 msgr2=0x55835b844e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b844e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc544009c30 tx=0x7fc544009190 comp rx=0 tx=0).stop 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 -- 172.21.15.155:0/58465492 shutdown_connections 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b844e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b8448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 --2- 172.21.15.155:0/58465492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b821800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 -- 172.21.15.155:0/58465492 >> 172.21.15.155:0/58465492 conn(0x55835b7d9fc0 msgr2=0x55835b81d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:32.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 -- 172.21.15.155:0/58465492 shutdown_connections 2024-04-25T13:16:32.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.288+0000 7fc55701c740 1 -- 172.21.15.155:0/58465492 wait complete. 2024-04-25T13:16:32.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.289+0000 7fc55701c740 1 -- start start 2024-04-25T13:16:32.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.289+0000 7fc55701c740 1 Processor -- start 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b7dd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b89ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b7fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55835b7fedd0 con 0x55835b8338f0 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55835b834110 con 0x55835b7da690 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55835b7ff440 con 0x55835b7daa70 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc55701c740 10 client.0 _ll_register_callbacks cb 0x7fc53c0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc5527c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b7fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc5527c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b7fcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50830/0 (socket says 172.21.15.155:50830) 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc5527c7640 1 -- 172.21.15.155:0/2452264249 learned_addr learned my addr 172.21.15.155:0/2452264249 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.290+0000 7fc551fc6640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b7dd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5517c5640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b89ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5527c7640 1 -- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 msgr2=0x55835b89ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5527c7640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b89ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5527c7640 1 -- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 msgr2=0x55835b7dd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5527c7640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b7dd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5527c7640 1 -- 172.21.15.155:0/2452264249 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835b89b140 con 0x55835b8338f0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc551fc6640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b7dd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc5527c7640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b7fcfd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc544021780 tx=0x7fc544004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34360f58c1b10a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc52cff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc52cff9640 1 -- 172.21.15.155:0/2452264249 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544030060 con 0x55835b8338f0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc52cff9640 1 -- 172.21.15.155:0/2452264249 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc544021cf0 con 0x55835b8338f0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc54401b070 con 0x55835b8338f0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc52cff9640 1 -- 172.21.15.155:0/2452264249 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fc544025070 con 0x55835b8338f0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc55701c740 10 client.4434 fetch_fsmap learned FSMap version 6 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55835b89b350 con 0x55835b8338f0 2024-04-25T13:16:32.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.291+0000 7fc52cff9640 1 -- 172.21.15.155:0/2452264249 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54401b070 con 0x55835b8338f0 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc52cff9640 1 -- 172.21.15.155:0/2452264249 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7fc544031260 con 0x55835b8338f0 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc55701c740 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc55701c740 10 client.4434 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc55701c740 20 client.4434 populate_metadata read hostname 'smithi155' 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc55701c740 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b894a80 0x55835b894e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc55701c740 4 client.4434 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 --> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] -- command(tid 0: {"prefix": "status"}) -- 0x55835b74b4e0 con 0x55835b894a80 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc551fc6640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b894a80 0x55835b894e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc52cff9640 10 client.4434 ms_handle_connect on v2:172.21.15.191:6835/2351082662 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.292+0000 7fc551fc6640 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b894a80 0x55835b894e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3cff8b6a680988 server_cookie=482226435374a8f4 in_seq=0 out_seq=0 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc52cff9640 1 -- 172.21.15.155:0/2452264249 <== mds.0 v2:172.21.15.191:6835/2351082662 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55835b74b4e0 con 0x55835b894a80 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc52cff9640 10 client.4434 handle_command_reply: tid=0 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 client.4434 shutdown 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 msgr2=0x55835b7fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b7fcfd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc544021780 tx=0x7fc544004730 comp rx=0 tx=0).stop 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 shutdown_connections 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55835b894a80 0x55835b894e60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55835b8338f0 0x55835b7fcfd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55835b7daa70 0x55835b89ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 --2- 172.21.15.155:0/2452264249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55835b7da690 0x55835b7dd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc52cff9640 0 client.4434 ms_handle_reset on v2:172.21.15.191:6835/2351082662 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 >> 172.21.15.155:0/2452264249 conn(0x55835b7d9fc0 msgr2=0x55835b82a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 shutdown_connections 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 1 -- 172.21.15.155:0/2452264249 wait complete. 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.293+0000 7fc55701c740 20 client.4434 trim_cache size 0 max 16384 2024-04-25T13:16:32.298 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "99137c81-994c-40b7-8b7f-aeb03a97ab57", 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4305, 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 10.632103905999999, 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 6, 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 25, 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 17.154470244999999 2024-04-25T13:16:32.299 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:16:32.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53006c8f0 msgr2=0x7fc53006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53006c8f0 0x7fc53006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5480012e0 tx=0x7fc548009040 comp rx=0 tx=0).stop 2024-04-25T13:16:32.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 msgr2=0x7fc54c15d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 0x7fc54c15d230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc53c000c00 tx=0x7fc53c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 shutdown_connections 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc54c0cdf80 0x7fc54c0ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc54c15f220 0x7fc54c15d230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 --2- 172.21.15.155:0/1293790992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc54c155230 0x7fc54c1f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 >> 172.21.15.155:0/1293790992 conn(0x7fc54c074f30 msgr2=0x7fc54c15c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 shutdown_connections 2024-04-25T13:16:32.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.294+0000 7fc55422a640 1 -- 172.21.15.155:0/1293790992 wait complete. 2024-04-25T13:16:32.307 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:16:32.307 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:32.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:16:32.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.409+0000 7fa098737640 1 Processor -- start 2024-04-25T13:16:32.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.409+0000 7fa098737640 1 -- start start 2024-04-25T13:16:32.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.410+0000 7fa098737640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa090151e70 0x7fa0900cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.410+0000 7fa098737640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa0900ca610 0x7fa0900cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.410+0000 7fa098737640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa090157e60 con 0x7fa0900c88f0 2024-04-25T13:16:32.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.410+0000 7fa098737640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa090157c30 con 0x7fa0900ca610 2024-04-25T13:16:32.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.410+0000 7fa098737640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa090158100 con 0x7fa090151e70 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa0964d3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa090151e70 0x7fa0900cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa096cd4640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa0900ca610 0x7fa0900cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa095cd2640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fa0900c88f0 0x7fa090072250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:41700/0 (socket says 172.21.15.155:41700) 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa095cd2640 1 -- 172.21.15.155:0/1252622848 learned_addr learned my addr 172.21.15.155:0/1252622848 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa096cd4640 1 -- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa090151e70 msgr2=0x7fa0900cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa096cd4640 1 --2- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa090151e70 0x7fa0900cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa096cd4640 1 -- 172.21.15.155:0/1252622848 >> v1:172.21.15.191:6789/0 conn(0x7fa0900c88f0 legacy=0x7fa090072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.411+0000 7fa096cd4640 1 -- 172.21.15.155:0/1252622848 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0901583a0 con 0x7fa0900ca610 2024-04-25T13:16:32.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.412+0000 7fa096cd4640 1 --2- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900cddd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa088009d90 tx=0x7fa08802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e37753bdd07610e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.412+0000 7fa0954d1640 1 -- 172.21.15.155:0/1252622848 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088007740 con 0x7fa0900ca610 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.412+0000 7fa0954d1640 1 -- 172.21.15.155:0/1252622848 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0880078e0 con 0x7fa0900ca610 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.412+0000 7fa0954d1640 1 -- 172.21.15.155:0/1252622848 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088007cb0 con 0x7fa0900ca610 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 -- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 msgr2=0x7fa0900cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 --2- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900cddd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa088009d90 tx=0x7fa08802a660 comp rx=0 tx=0).stop 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 -- 172.21.15.155:0/1252622848 shutdown_connections 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 --2- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900cddd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 --2- 172.21.15.155:0/1252622848 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa090151e70 0x7fa0900cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 -- 172.21.15.155:0/1252622848 >> 172.21.15.155:0/1252622848 conn(0x7fa09006b920 msgr2=0x7fa09006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:32.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 -- 172.21.15.155:0/1252622848 shutdown_connections 2024-04-25T13:16:32.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.413+0000 7fa098737640 1 -- 172.21.15.155:0/1252622848 wait complete. 2024-04-25T13:16:32.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.414+0000 7fa098737640 1 Processor -- start 2024-04-25T13:16:32.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.414+0000 7fa098737640 1 -- start start 2024-04-25T13:16:32.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.414+0000 7fa098737640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0900c88f0 0x7fa0901eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 0x7fa0901592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa090152250 con 0x7fa090151e70 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa090158920 con 0x7fa0900ca610 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa0901523d0 con 0x7fa0900c88f0 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 0x7fa0901592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 0x7fa0901592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:50846/0 (socket says 172.21.15.155:50846) 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 -- 172.21.15.155:0/778812603 learned_addr learned my addr 172.21.15.155:0/778812603 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa0964d3640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0900c88f0 0x7fa0901eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa095cd2640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 -- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0900c88f0 msgr2=0x7fa0901eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0900c88f0 0x7fa0901eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 -- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 msgr2=0x7fa0900c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 -- 172.21.15.155:0/778812603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0900c76d0 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa096cd4640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 0x7fa0901592a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa088009eb0 tx=0x7fa088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088040070 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa088031bc0 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0900c79b0 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088009450 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.415+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0900c5cc0 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.416+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa090068e40 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.417+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa088039040 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.417+0000 7fa086ffd640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa07406c920 0x7fa07406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.417+0000 7fa0964d3640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa07406c920 0x7fa07406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.417+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa0880ad5f0 con 0x7fa090151e70 2024-04-25T13:16:32.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.418+0000 7fa0964d3640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa07406c920 0x7fa07406ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa080009aa0 tx=0x7fa080009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:32.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.422+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa08807b120 con 0x7fa090151e70 2024-04-25T13:16:32.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.636+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0900c91d0 con 0x7fa090151e70 2024-04-25T13:16:32.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.636+0000 7fa086ffd640 1 -- 172.21.15.155:0/778812603 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fa08807f420 con 0x7fa090151e70 2024-04-25T13:16:32.636 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:16:32.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa07406c920 msgr2=0x7fa07406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa07406c920 0x7fa07406ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa080009aa0 tx=0x7fa080009190 comp rx=0 tx=0).stop 2024-04-25T13:16:32.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 msgr2=0x7fa0901592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:32.638 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 0x7fa0901592a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa088009eb0 tx=0x7fa088004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 shutdown_connections 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa090151e70 0x7fa0901592a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0900ca610 0x7fa0900c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa07406c920 0x7fa07406ede0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 --2- 172.21.15.155:0/778812603 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0900c88f0 0x7fa0901eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 >> 172.21.15.155:0/778812603 conn(0x7fa09006b920 msgr2=0x7fa0900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 shutdown_connections 2024-04-25T13:16:32.639 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32.638+0000 7fa098737640 1 -- 172.21.15.155:0/778812603 wait complete. 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:16:32.649 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:16:32.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:32.649 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-04-25T13:16:32.664 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:16:32.664 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:16:32.664 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:16:32.664 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:32.664 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ff1:516:a0c2:65b7/64 scope link noprefixroute 2024-04-25T13:16:32.665 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:16:32.666 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:16:32.666 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:16:32.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:32.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:32.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:32.892 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:16:32.915 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-25T13:16:32.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:32.917 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-04-25T13:16:32.980 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-04-25T13:16:32.980 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:16:32.980 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:16:32.980 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:16:32.980 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:16:32.981 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:32.981 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:16:32.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:16:32.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:16:32.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:16:32.981 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:16:33.068 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:33.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:33.265 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T13:16:33.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:33.281 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-04-25T13:16:33.335 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:33.336 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:16:33.336 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:33.336 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T13:16:33.336 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:16:33.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:33.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:33.450 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T13:16:33.451 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:16:33.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:33.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:33.573 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:16:33.573 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:16:33.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-04-25T13:16:33.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:16:33.573 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:16:33.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:16:33.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:33.648 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T13:16:33.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:16:33.648 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T13:16:33.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:16:33.663 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:33.719 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T13:16:33.783 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T13:16:33.839 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:33.840 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:33.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:33.842 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T13:16:33.894 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:16:33.894 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T13:16:33.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T13:16:33.959 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T13:16:34.015 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T13:16:34.016 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:34.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:34.017 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T13:16:34.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi155.stderr:2024-04-25T13:16:34.070+0000 7f92b094e480 -1 init, newargv = 0x55ff31d807b0 newargc=15 2024-04-25T13:16:34.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi155.stderr:ceph-fuse[42436]: starting ceph client 2024-04-25T13:16:34.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi155.stderr:ceph-fuse[42436]: starting fuse 2024-04-25T13:16:35.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T13:16:35.201 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:16:35.259 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T13:16:35.260 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T13:16:35.261 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:35.262 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:16:35.262 INFO:teuthology.orchestra.run.smithi155.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:35.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:35.263 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T13:16:35.319 INFO:teuthology.orchestra.run.smithi155.stdout:42 2024-04-25T13:16:35.319 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-25T13:16:35.319 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:16:35.319 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-04-25T13:16:35.319 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:16:35.320 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.admin")) 2024-04-25T13:16:35.321 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-04-25T13:16:35.442 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.admin.42436.asok 2024-04-25T13:16:35.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:35.453 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42436.asok 2024-04-25T13:16:35.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:35.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42436.asok status 2024-04-25T13:16:35.587 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "admin", 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "42436", 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4440, 2024-04-25T13:16:35.588 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4440 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 3915122180 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 3915122180 2024-04-25T13:16:35.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4440 192.168.0.1:0/3915122180", 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/3915122180", 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 6, 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 25, 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-04-25T13:16:35.590 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:16:35.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:35.596 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-04-25T13:16:35.596 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:35.611 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-04-25T13:16:35.611 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:35.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:35.611 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:35.676 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T13:16:35.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:16:36.097 INFO:teuthology.orchestra.run.smithi155.stdout:# file: . 2024-04-25T13:16:36.098 INFO:teuthology.orchestra.run.smithi155.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T13:16:36.098 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:36.098 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:16:36.104 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:16:36.104 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:16:36.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:36.134 INFO:tasks.ceph.mds.b.smithi191.stderr:2024-04-25T13:16:36.134+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:16:36.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.256+0000 7f8d2aafc640 1 Processor -- start 2024-04-25T13:16:36.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.256+0000 7f8d2aafc640 1 -- start start 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d2aafc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d24075850 0x7f8d24074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d2aafc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d240cd830 con 0x7f8d24144300 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d2aafc640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d241446e0 con 0x7f8d2415f2a0 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d2aafc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8d2415ee10 con 0x7f8d24075850 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d29099640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d24075850 0x7f8d24074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d28898640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8d24144300 0x7f8d240c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35882/0 (socket says 172.21.15.155:35882) 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d28898640 1 -- 172.21.15.155:0/435545690 learned_addr learned my addr 172.21.15.155:0/435545690 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d29099640 1 -- 172.21.15.155:0/435545690 >> v1:172.21.15.191:6789/0 conn(0x7f8d2415f2a0 legacy=0x7f8d2415b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d29099640 1 -- 172.21.15.155:0/435545690 >> v1:172.21.15.155:6789/0 conn(0x7f8d24144300 legacy=0x7f8d240c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d237fe640 1 -- 172.21.15.155:0/435545690 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660779740 0 0) 0x7f8d240cd830 con 0x7f8d24144300 2024-04-25T13:16:36.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.257+0000 7f8d29099640 1 -- 172.21.15.155:0/435545690 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2415bac0 con 0x7f8d24075850 2024-04-25T13:16:36.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.258+0000 7f8d29099640 1 --2- 172.21.15.155:0/435545690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d24074d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d2415ef90 tx=0x7f8d1c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f888fec9f79d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.258+0000 7f8d237fe640 1 -- 172.21.15.155:0/435545690 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c037070 con 0x7f8d24075850 2024-04-25T13:16:36.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.258+0000 7f8d237fe640 1 -- 172.21.15.155:0/435545690 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1c007740 con 0x7f8d24075850 2024-04-25T13:16:36.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.258+0000 7f8d237fe640 1 -- 172.21.15.155:0/435545690 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c007b10 con 0x7f8d24075850 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 -- 172.21.15.155:0/435545690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 msgr2=0x7f8d24074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/435545690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d24074d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d2415ef90 tx=0x7f8d1c02a780 comp rx=0 tx=0).stop 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 -- 172.21.15.155:0/435545690 shutdown_connections 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/435545690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d24074d50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 -- 172.21.15.155:0/435545690 >> 172.21.15.155:0/435545690 conn(0x7f8d2406b920 msgr2=0x7f8d2406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 -- 172.21.15.155:0/435545690 shutdown_connections 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.259+0000 7f8d2aafc640 1 -- 172.21.15.155:0/435545690 wait complete. 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.260+0000 7f8d2aafc640 1 Processor -- start 2024-04-25T13:16:36.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.260+0000 7f8d2aafc640 1 -- start start 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d241e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d24144300 0x7f8d240c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d2415f2a0 0x7f8d240cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2415eaa0 con 0x7f8d24075850 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2415e7c0 con 0x7f8d2415f2a0 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2415b720 con 0x7f8d24144300 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d241e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d241e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59338/0 (socket says 172.21.15.155:59338) 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 -- 172.21.15.155:0/4105768445 learned_addr learned my addr 172.21.15.155:0/4105768445 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d29099640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d2415f2a0 0x7f8d240cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 -- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d24144300 msgr2=0x7f8d240c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d24144300 0x7f8d240c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 -- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d2415f2a0 msgr2=0x7f8d240cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d2415f2a0 0x7f8d240cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 -- 172.21.15.155:0/4105768445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d241e4910 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d29099640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d2415f2a0 0x7f8d240cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d28898640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d241e43d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400c4a0 tx=0x7f8d1400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14018070 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d140074e0 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14004a20 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d241f47c0 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.261+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d241f5060 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.263+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d24074000 con 0x7f8d24075850 2024-04-25T13:16:36.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.263+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d1401b070 con 0x7f8d24075850 2024-04-25T13:16:36.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.263+0000 7f8d217fa640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8d1006c920 0x7f8d1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.263+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d1408b0c0 con 0x7f8d24075850 2024-04-25T13:16:36.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.263+0000 7f8d23fff640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8d1006c920 0x7f8d1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.264+0000 7f8d23fff640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8d1006c920 0x7f8d1006ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d18000f60 tx=0x7f8d180079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.268+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8d24074000 con 0x7f8d24075850 2024-04-25T13:16:36.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.444+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d24068e40 con 0x7f8d24075850 2024-04-25T13:16:36.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.445+0000 7f8d217fa640 1 -- 172.21.15.155:0/4105768445 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7f8d14059240 con 0x7f8d24075850 2024-04-25T13:16:36.446 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:36.446 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8d1006c920 msgr2=0x7f8d1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8d1006c920 0x7f8d1006ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d18000f60 tx=0x7f8d180079b0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 msgr2=0x7f8d241e43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d241e43d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400c4a0 tx=0x7f8d1400c960 comp rx=0 tx=0).stop 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 shutdown_connections 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d2415f2a0 0x7f8d240cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8d1006c920 0x7f8d1006ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8d24144300 0x7f8d240c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 --2- 172.21.15.155:0/4105768445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d24075850 0x7f8d241e43d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 >> 172.21.15.155:0/4105768445 conn(0x7f8d2406b920 msgr2=0x7f8d241432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 shutdown_connections 2024-04-25T13:16:36.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.447+0000 7f8d2aafc640 1 -- 172.21.15.155:0/4105768445 wait complete. 2024-04-25T13:16:36.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:19.529860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:19.949095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:23.675819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:36.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.559+0000 7f51c5a60640 1 Processor -- start 2024-04-25T13:16:36.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.559+0000 7f51c5a60640 1 -- start start 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.559+0000 7f51c5a60640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 0x7f51c00c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.559+0000 7f51c5a60640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c015eaa0 con 0x7f51c0155710 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.559+0000 7f51c5a60640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c015ed80 con 0x7f51c006c880 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.559+0000 7f51c5a60640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f51c00c8940 con 0x7f51c00c7c20 2024-04-25T13:16:36.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51beffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f51c0155710 0x7f51c00cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35884/0 (socket says 172.21.15.155:35884) 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51beffd640 1 -- 172.21.15.155:0/3398906282 learned_addr learned my addr 172.21.15.155:0/3398906282 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51bf7fe640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 0x7f51c00c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872641968 0 0) 0x7f51c015eaa0 con 0x7f51c0155710 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51ac003520 con 0x7f51c0155710 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409679975 0 0) 0x7f51c015ed80 con 0x7f51c006c880 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51c015eaa0 con 0x7f51c006c880 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1678861817 0 0) 0x7f51ac003520 con 0x7f51c0155710 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 msgr2=0x7f51c00c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 0x7f51c00c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 >> v1:172.21.15.191:6789/0 conn(0x7f51c006c880 legacy=0x7f51c006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c015f060 con 0x7f51c0155710 2024-04-25T13:16:36.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f51b0001670 con 0x7f51c0155710 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 >> v1:172.21.15.155:6789/0 conn(0x7f51c0155710 legacy=0x7f51c00cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51ac003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ac004800 0x7f51ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 0x7f51ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00c8940 con 0x7f51ac003b70 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac00ba70 con 0x7f51ac004800 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac00bc70 con 0x7f51c00c7c20 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51beffd640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51ac003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51b7fff640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ac004800 0x7f51ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.560+0000 7f51bf7fe640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 0x7f51ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51beffd640 1 -- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 msgr2=0x7f51ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51beffd640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c00c7c20 0x7f51ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51beffd640 1 -- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ac004800 msgr2=0x7f51ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:36.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51beffd640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51ac004800 0x7f51ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51beffd640 1 -- 172.21.15.155:0/3398906282 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac003520 con 0x7f51ac003b70 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51beffd640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51ac003f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c1e0 tx=0x7f51ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c941643ca3354dea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0007c40 con 0x7f51ac003b70 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0005ad0 con 0x7f51ac003b70 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.561+0000 7f51be7fc640 1 -- 172.21.15.155:0/3398906282 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0007070 con 0x7f51ac003b70 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51c5a60640 1 -- 172.21.15.155:0/3398906282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 msgr2=0x7f51ac003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51c5a60640 1 --2- 172.21.15.155:0/3398906282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51ac003f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c1e0 tx=0x7f51ac005830 comp rx=0 tx=0).stop 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51bf7fe640 1 -- 172.21.15.155:0/3398906282 reap_dead start 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51c5a60640 1 -- 172.21.15.155:0/3398906282 shutdown_connections 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51c5a60640 1 -- 172.21.15.155:0/3398906282 >> 172.21.15.155:0/3398906282 conn(0x7f51c00731d0 msgr2=0x7f51c00735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51c5a60640 1 -- 172.21.15.155:0/3398906282 shutdown_connections 2024-04-25T13:16:36.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.562+0000 7f51c5a60640 1 -- 172.21.15.155:0/3398906282 wait complete. 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.563+0000 7f51c5a60640 1 Processor -- start 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.563+0000 7f51c5a60640 1 -- start start 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51c5a60640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51c0149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51c5a60640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51c01f1f40 0x7f51c00ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51c5a60640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c014bbd0 0x7f51c014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51c5a60640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f51c015f6b0 con 0x7f51ac003b70 2024-04-25T13:16:36.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51c5a60640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f51c0155af0 con 0x7f51c01f1f40 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51c5a60640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f51c00cc120 con 0x7f51c014bbd0 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51c0149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51c0149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59370/0 (socket says 172.21.15.155:59370) 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 -- 172.21.15.155:0/2693091819 learned_addr learned my addr 172.21.15.155:0/2693091819 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51b7fff640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51c01f1f40 0x7f51c00ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51bf7fe640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c014bbd0 0x7f51c014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 -- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c014bbd0 msgr2=0x7f51c014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c014bbd0 0x7f51c014c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 -- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51c01f1f40 msgr2=0x7f51c00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51c01f1f40 0x7f51c00ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 -- 172.21.15.155:0/2693091819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c014c590 con 0x7f51ac003b70 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.564+0000 7f51beffd640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51c0149ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c300 tx=0x7f51c00c46c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.565+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0037040 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.565+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b0041070 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.565+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c014b410 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.565+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b0001b70 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.565+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c014a880 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.566+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c0068f50 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.566+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51b00049e0 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.567+0000 7f51bcff9640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f51a006c920 0x7f51a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.567+0000 7f51b7fff640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f51a006c920 0x7f51a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.567+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f51b00ab670 con 0x7f51ac003b70 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.567+0000 7f51b7fff640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f51a006c920 0x7f51a006ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51c014ca70 tx=0x7f51a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.571+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f51c014c590 con 0x7f51ac003b70 2024-04-25T13:16:36.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.749+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51c00c0420 con 0x7f51ac003b70 2024-04-25T13:16:36.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.749+0000 7f51bcff9640 1 -- 172.21.15.155:0/2693091819 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f51b0079760 con 0x7f51ac003b70 2024-04-25T13:16:36.750 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f51a006c920 msgr2=0x7f51a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f51a006c920 0x7f51a006ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51c014ca70 tx=0x7f51a8009040 comp rx=0 tx=0).stop 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 msgr2=0x7f51c0149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51c0149ef0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f51b000c300 tx=0x7f51c00c46c0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 shutdown_connections 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f51a006c920 0x7f51a006ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f51c014bbd0 0x7f51c014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f51c01f1f40 0x7f51c00ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 --2- 172.21.15.155:0/2693091819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51ac003b70 0x7f51c0149ef0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 >> 172.21.15.155:0/2693091819 conn(0x7f51c00731d0 msgr2=0x7f51c00c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 shutdown_connections 2024-04-25T13:16:36.754 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.751+0000 7f51c5a60640 1 -- 172.21.15.155:0/2693091819 wait complete. 2024-04-25T13:16:36.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:36.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.862+0000 7fd08eca7640 1 Processor -- start 2024-04-25T13:16:36.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.862+0000 7fd08eca7640 1 -- start start 2024-04-25T13:16:36.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08eca7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fd088155260 0x7fd0880cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08eca7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0880ce850 con 0x7fd08815bd00 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08eca7640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0880ceb10 con 0x7fd0880740b0 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08eca7640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fd08815b160 con 0x7fd088155260 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08d244640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd08815bd00 0x7fd08815e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35896/0 (socket says 172.21.15.155:35896) 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08d244640 1 -- 172.21.15.155:0/1472226061 learned_addr learned my addr 172.21.15.155:0/1472226061 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08ca43640 1 --2- 172.21.15.155:0/1472226061 >> v2:172.21.15.191:3300/0 conn(0x7fd088155260 0x7fd0880cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd0877fe640 1 -- 172.21.15.155:0/1472226061 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516613267 0 0) 0x7fd0880ce850 con 0x7fd08815bd00 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd0877fe640 1 -- 172.21.15.155:0/1472226061 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd078003520 con 0x7fd08815bd00 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08ca43640 1 -- 172.21.15.155:0/1472226061 >> v1:172.21.15.191:6789/0 conn(0x7fd0880740b0 legacy=0x7fd08815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd0877fe640 1 -- 172.21.15.155:0/1472226061 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4181218206 0 0) 0x7fd0880ceb10 con 0x7fd0880740b0 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08ca43640 1 -- 172.21.15.155:0/1472226061 >> v1:172.21.15.155:6789/0 conn(0x7fd08815bd00 legacy=0x7fd08815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.863+0000 7fd08ca43640 1 -- 172.21.15.155:0/1472226061 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0880cedf0 con 0x7fd088155260 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.864+0000 7fd08ca43640 1 --2- 172.21.15.155:0/1472226061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd0880cad90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0097a0 tx=0x7fd07c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa568f48285b5761 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.864+0000 7fd0877fe640 1 -- 172.21.15.155:0/1472226061 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c037070 con 0x7fd088155260 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.864+0000 7fd0877fe640 1 -- 172.21.15.155:0/1472226061 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c032440 con 0x7fd088155260 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.864+0000 7fd0877fe640 1 -- 172.21.15.155:0/1472226061 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0327f0 con 0x7fd088155260 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 -- 172.21.15.155:0/1472226061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 msgr2=0x7fd0880cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 --2- 172.21.15.155:0/1472226061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd0880cad90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0097a0 tx=0x7fd07c02a230 comp rx=0 tx=0).stop 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 -- 172.21.15.155:0/1472226061 shutdown_connections 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 --2- 172.21.15.155:0/1472226061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd0880cad90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 -- 172.21.15.155:0/1472226061 >> 172.21.15.155:0/1472226061 conn(0x7fd088073590 msgr2=0x7fd0880739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 -- 172.21.15.155:0/1472226061 shutdown_connections 2024-04-25T13:16:36.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.865+0000 7fd08eca7640 1 -- 172.21.15.155:0/1472226061 wait complete. 2024-04-25T13:16:36.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.866+0000 7fd08eca7640 1 Processor -- start 2024-04-25T13:16:36.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.866+0000 7fd08eca7640 1 -- start start 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08eca7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880740b0 0x7fd0880ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08eca7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd088158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08eca7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 0x7fd0880c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08eca7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd088155640 con 0x7fd08815bd00 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08eca7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd0880cf3b0 con 0x7fd088155260 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08eca7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd0881557c0 con 0x7fd0880740b0 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 0x7fd0880c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 0x7fd0880c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59374/0 (socket says 172.21.15.155:59374) 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 -- 172.21.15.155:0/2883985627 learned_addr learned my addr 172.21.15.155:0/2883985627 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd087fff640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd088158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08ca43640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880740b0 0x7fd0880ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 -- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880740b0 msgr2=0x7fd0880ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880740b0 0x7fd0880ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 -- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 msgr2=0x7fd088158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd088158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.867+0000 7fd08d244640 1 -- 172.21.15.155:0/2883985627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0881f0b90 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.868+0000 7fd08d244640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 0x7fd0880c7410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd08000ca50 tx=0x7fd08000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.868+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080017070 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.868+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08000abb0 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.868+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0881f0e50 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.868+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080012400 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.868+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0881f1410 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.869+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0881f1610 con 0x7fd08815bd00 2024-04-25T13:16:36.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.869+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd08001a070 con 0x7fd08815bd00 2024-04-25T13:16:36.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.869+0000 7fd0857fa640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd06c06c920 0x7fd06c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:36.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.870+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd08008bb80 con 0x7fd08815bd00 2024-04-25T13:16:36.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.870+0000 7fd08ca43640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd06c06c920 0x7fd06c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:36.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.870+0000 7fd08ca43640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd06c06c920 0x7fd06c06ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd07c034000 tx=0x7fd07c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:36.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:36.874+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0881f1610 con 0x7fd08815bd00 2024-04-25T13:16:37.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.048+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd088068e40 con 0x7fd08815bd00 2024-04-25T13:16:37.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.048+0000 7fd0857fa640 1 -- 172.21.15.155:0/2883985627 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fd0800595a0 con 0x7fd08815bd00 2024-04-25T13:16:37.049 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:16:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd06c06c920 msgr2=0x7fd06c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd06c06c920 0x7fd06c06ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd07c034000 tx=0x7fd07c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 msgr2=0x7fd0880c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 0x7fd0880c7410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd08000ca50 tx=0x7fd08000cf10 comp rx=0 tx=0).stop 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 shutdown_connections 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd08815bd00 0x7fd0880c7410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd088155260 0x7fd088158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd06c06c920 0x7fd06c06ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 --2- 172.21.15.155:0/2883985627 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd0880740b0 0x7fd0880ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 >> 172.21.15.155:0/2883985627 conn(0x7fd088073590 msgr2=0x7fd08814a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 shutdown_connections 2024-04-25T13:16:37.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.050+0000 7fd08eca7640 1 -- 172.21.15.155:0/2883985627 wait complete. 2024-04-25T13:16:37.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.161+0000 7f28ab36f640 1 Processor -- start 2024-04-25T13:16:37.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.161+0000 7f28ab36f640 1 -- start start 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28ab36f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28ab36f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28a406cfe0 0x7f28a4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28ab36f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a415f500 con 0x7f28a40cbc00 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28ab36f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f28a40cd140 con 0x7f28a406cfe0 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28ab36f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f28a415b190 con 0x7f28a406cc00 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a890a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f28a406cfe0 0x7f28a4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a990c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f28a40cbc00 0x7f28a40c5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35904/0 (socket says 172.21.15.155:35904) 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a990c640 1 -- 172.21.15.155:0/4156942866 learned_addr learned my addr 172.21.15.155:0/4156942866 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a910b640 1 --2- 172.21.15.155:0/4156942866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a890a640 1 -- 172.21.15.155:0/4156942866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 msgr2=0x7f28a415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a890a640 1 --2- 172.21.15.155:0/4156942866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f28a890a640 1 -- 172.21.15.155:0/4156942866 >> v1:172.21.15.155:6789/0 conn(0x7f28a40cbc00 legacy=0x7f28a40c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.162+0000 7f289bfff640 1 -- 172.21.15.155:0/4156942866 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045450588 0 0) 0x7f289c001110 con 0x7f28a40cbc00 2024-04-25T13:16:37.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.163+0000 7f28a890a640 1 -- 172.21.15.155:0/4156942866 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a415b470 con 0x7f28a406cfe0 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.163+0000 7f28a890a640 1 --2- 172.21.15.155:0/4156942866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a406cfe0 0x7f28a4154f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28940097a0 tx=0x7f289402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d441b8e0fdfac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.163+0000 7f289bfff640 1 -- 172.21.15.155:0/4156942866 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894037070 con 0x7f28a406cfe0 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.163+0000 7f289bfff640 1 -- 172.21.15.155:0/4156942866 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2894032440 con 0x7f28a406cfe0 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.163+0000 7f289bfff640 1 -- 172.21.15.155:0/4156942866 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894032810 con 0x7f28a406cfe0 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 -- 172.21.15.155:0/4156942866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a406cfe0 msgr2=0x7f28a4154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 --2- 172.21.15.155:0/4156942866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a406cfe0 0x7f28a4154f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28940097a0 tx=0x7f289402a210 comp rx=0 tx=0).stop 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 -- 172.21.15.155:0/4156942866 shutdown_connections 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 --2- 172.21.15.155:0/4156942866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a406cfe0 0x7f28a4154f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 --2- 172.21.15.155:0/4156942866 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 -- 172.21.15.155:0/4156942866 >> 172.21.15.155:0/4156942866 conn(0x7f28a4075570 msgr2=0x7f28a4073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 -- 172.21.15.155:0/4156942866 shutdown_connections 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.164+0000 7f28ab36f640 1 -- 172.21.15.155:0/4156942866 wait complete. 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.165+0000 7f28ab36f640 1 Processor -- start 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.165+0000 7f28ab36f640 1 -- start start 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28ab36f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28ab36f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28a406cfe0 0x7f28a41f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28ab36f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 0x7f28a4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28ab36f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28a415bd10 con 0x7f28a40cbc00 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28ab36f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f28a415ba30 con 0x7f28a406cfe0 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28ab36f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40c6010 con 0x7f28a406cc00 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 0x7f28a4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 0x7f28a4159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59404/0 (socket says 172.21.15.155:59404) 2024-04-25T13:16:37.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 -- 172.21.15.155:0/737572317 learned_addr learned my addr 172.21.15.155:0/737572317 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a890a640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28a406cfe0 0x7f28a41f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a910b640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 -- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 msgr2=0x7f28a415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 -- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28a406cfe0 msgr2=0x7f28a41f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28a406cfe0 0x7f28a41f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 -- 172.21.15.155:0/737572317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a415dc00 con 0x7f28a40cbc00 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a910b640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.166+0000 7f28a990c640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 0x7f28a4159360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c440 tx=0x7f289c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.167+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c0074e0 con 0x7f28a40cbc00 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.167+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c0047e0 con 0x7f28a40cbc00 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.167+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c004bd0 con 0x7f28a40cbc00 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.167+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a415dee0 con 0x7f28a40cbc00 2024-04-25T13:16:37.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.167+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a4159e80 con 0x7f28a40cbc00 2024-04-25T13:16:37.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.168+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a4068f50 con 0x7f28a40cbc00 2024-04-25T13:16:37.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.168+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f289c011070 con 0x7f28a40cbc00 2024-04-25T13:16:37.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.168+0000 7f2899ffb640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288806c920 0x7f288806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.169+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f289c08b960 con 0x7f28a40cbc00 2024-04-25T13:16:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.169+0000 7f28a910b640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288806c920 0x7f288806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.169+0000 7f28a910b640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288806c920 0x7f288806ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009b20 tx=0x7f28a00039d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.173 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.173+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28a415f500 con 0x7f28a40cbc00 2024-04-25T13:16:37.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.346+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f28a4158cd0 con 0x7f28a40cbc00 2024-04-25T13:16:37.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.346+0000 7f2899ffb640 1 -- 172.21.15.155:0/737572317 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f289c059a50 con 0x7f28a40cbc00 2024-04-25T13:16:37.347 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-04-25T13:16:37.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288806c920 msgr2=0x7f288806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288806c920 0x7f288806ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009b20 tx=0x7f28a00039d0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.349 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 msgr2=0x7f28a4159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 0x7f28a4159360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c440 tx=0x7f289c00c900 comp rx=0 tx=0).stop 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 shutdown_connections 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28a40cbc00 0x7f28a4159360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28a406cfe0 0x7f28a41f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288806c920 0x7f288806ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 --2- 172.21.15.155:0/737572317 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f28a406cc00 0x7f28a415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 >> 172.21.15.155:0/737572317 conn(0x7f28a4075570 msgr2=0x7f28a4153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 shutdown_connections 2024-04-25T13:16:37.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.348+0000 7f28ab36f640 1 -- 172.21.15.155:0/737572317 wait complete. 2024-04-25T13:16:37.360 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:37.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.459+0000 7f6a97ecf640 1 Processor -- start 2024-04-25T13:16:37.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.459+0000 7f6a97ecf640 1 -- start start 2024-04-25T13:16:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a97ecf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 0x7f6a900cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a97ecf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a900d1510 con 0x7f6a901554e0 2024-04-25T13:16:37.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a97ecf640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9015b5d0 con 0x7f6a900cbd40 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a97ecf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6a900cced0 con 0x7f6a900cc6f0 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a95c6b640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6a901554e0 0x7f6a900d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35910/0 (socket says 172.21.15.155:35910) 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a95c6b640 1 -- 172.21.15.155:0/3742831205 learned_addr learned my addr 172.21.15.155:0/3742831205 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a9546a640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 0x7f6a900cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221652905 0 0) 0x7f6a900d1510 con 0x7f6a901554e0 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a7c003520 con 0x7f6a901554e0 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.460+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1113165745 0 0) 0x7f6a7c003520 con 0x7f6a901554e0 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 msgr2=0x7f6a900cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 0x7f6a900cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 >> v1:172.21.15.191:6789/0 conn(0x7f6a900cbd40 legacy=0x7f6a900cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9015b8b0 con 0x7f6a901554e0 2024-04-25T13:16:37.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f6a8c0019f0 con 0x7f6a901554e0 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 >> v1:172.21.15.155:6789/0 conn(0x7f6a901554e0 legacy=0x7f6a900d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c0039e0 0x7f6a7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 0x7f6a7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c004d40 0x7f6a7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900cced0 con 0x7f6a7c0039e0 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c00b9c0 con 0x7f6a7c004d40 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c00bbc0 con 0x7f6a900cc6f0 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c0039e0 0x7f6a7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a9646c640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c004d40 0x7f6a7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a9546a640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 0x7f6a7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a95c6b640 1 -- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 msgr2=0x7f6a7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900cc6f0 0x7f6a7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a95c6b640 1 -- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c004d40 msgr2=0x7f6a7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c004d40 0x7f6a7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.461+0000 7f6a95c6b640 1 -- 172.21.15.155:0/3742831205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c003520 con 0x7f6a7c0039e0 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c0039e0 0x7f6a7c003dc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00a810 tx=0x7f6a7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9007714c712344e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00a430 con 0x7f6a7c0039e0 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c02f070 con 0x7f6a7c0039e0 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a94c69640 1 -- 172.21.15.155:0/3742831205 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c02bbc0 con 0x7f6a7c0039e0 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a97ecf640 1 -- 172.21.15.155:0/3742831205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c0039e0 msgr2=0x7f6a7c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/3742831205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a7c0039e0 0x7f6a7c003dc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00a810 tx=0x7f6a7c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a9646c640 1 -- 172.21.15.155:0/3742831205 reap_dead start 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a97ecf640 1 -- 172.21.15.155:0/3742831205 shutdown_connections 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a97ecf640 1 -- 172.21.15.155:0/3742831205 >> 172.21.15.155:0/3742831205 conn(0x7f6a90074d50 msgr2=0x7f6a90075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.462+0000 7f6a97ecf640 1 -- 172.21.15.155:0/3742831205 shutdown_connections 2024-04-25T13:16:37.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.463+0000 7f6a97ecf640 1 -- 172.21.15.155:0/3742831205 wait complete. 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 Processor -- start 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 -- start start 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c0039e0 0x7f6a901f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 0x7f6a900c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900d0530 0x7f6a900c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900d11e0 con 0x7f6a900d0110 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9015bf00 con 0x7f6a7c0039e0 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a97ecf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9015b280 con 0x7f6a900d0530 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a9546a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 0x7f6a900c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.469 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a9546a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 0x7f6a900c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59426/0 (socket says 172.21.15.155:59426) 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a9546a640 1 -- 172.21.15.155:0/65052122 learned_addr learned my addr 172.21.15.155:0/65052122 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c0039e0 0x7f6a901f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.464+0000 7f6a9646c640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900d0530 0x7f6a900c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9546a640 1 -- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900d0530 msgr2=0x7f6a900c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9546a640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900d0530 0x7f6a900c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9546a640 1 -- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c0039e0 msgr2=0x7f6a901f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9546a640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c0039e0 0x7f6a901f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9546a640 1 -- 172.21.15.155:0/65052122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a900cad70 con 0x7f6a900d0110 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9646c640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900d0530 0x7f6a900c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a9546a640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 0x7f6a900c9350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a800119a0 tx=0x7f6a80011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000faf0 con 0x7f6a900d0110 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8000fc90 con 0x7f6a900d0110 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a900c7e60 con 0x7f6a900d0110 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80014440 con 0x7f6a900d0110 2024-04-25T13:16:37.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.465+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a900c8420 con 0x7f6a900d0110 2024-04-25T13:16:37.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.466+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9015b5d0 con 0x7f6a900d0110 2024-04-25T13:16:37.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.466+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a80012040 con 0x7f6a900d0110 2024-04-25T13:16:37.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.467+0000 7f6a867fc640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6a7406c8f0 0x7f6a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.467+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6a7406c8f0 0x7f6a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.467+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6a8008c480 con 0x7f6a900d0110 2024-04-25T13:16:37.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.467+0000 7f6a95c6b640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6a7406c8f0 0x7f6a7406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c033000 tx=0x7f6a8c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.471+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a9015b5d0 con 0x7f6a900d0110 2024-04-25T13:16:37.650 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.649+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6a90075d60 con 0x7f6a900d0110 2024-04-25T13:16:37.650 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.649+0000 7f6a867fc640 1 -- 172.21.15.155:0/65052122 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f6a90075d60 con 0x7f6a900d0110 2024-04-25T13:16:37.650 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:16:37.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6a7406c8f0 msgr2=0x7f6a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6a7406c8f0 0x7f6a7406edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c033000 tx=0x7f6a8c009030 comp rx=0 tx=0).stop 2024-04-25T13:16:37.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 msgr2=0x7f6a900c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.652 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 0x7f6a900c9350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6a800119a0 tx=0x7f6a80011e60 comp rx=0 tx=0).stop 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 shutdown_connections 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6a7406c8f0 0x7f6a7406edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6a900d0530 0x7f6a900c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a900d0110 0x7f6a900c9350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 --2- 172.21.15.155:0/65052122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6a7c0039e0 0x7f6a901f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 >> 172.21.15.155:0/65052122 conn(0x7f6a90074d50 msgr2=0x7f6a9015a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 shutdown_connections 2024-04-25T13:16:37.653 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.651+0000 7f6a97ecf640 1 -- 172.21.15.155:0/65052122 wait complete. 2024-04-25T13:16:37.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:16:37.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 Processor -- start 2024-04-25T13:16:37.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 -- start start 2024-04-25T13:16:37.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa1ec153150 0x7fa1ec06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 0x7fa1ec15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1ec075c50 con 0x7fa1ec0c6b80 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa1ec0caef0 con 0x7fa1ec153150 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.763+0000 7fa1f2708640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ec0753a0 con 0x7fa1ec075830 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1f0ca5640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa1ec0c6b80 0x7fa1ec0c4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35914/0 (socket says 172.21.15.155:35914) 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1f0ca5640 1 -- 172.21.15.155:0/2638136114 learned_addr learned my addr 172.21.15.155:0/2638136114 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1ebfff640 1 --2- 172.21.15.155:0/2638136114 >> v2:172.21.15.191:3300/0 conn(0x7fa1ec153150 0x7fa1ec06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 0x7fa1ec15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561441696 0 0) 0x7fa1ec075c50 con 0x7fa1ec0c6b80 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d8003520 con 0x7fa1ec0c6b80 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1171708813 0 0) 0x7fa1d8003520 con 0x7fa1ec0c6b80 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 msgr2=0x7fa1ec15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 0x7fa1ec15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 >> v2:172.21.15.191:3300/0 conn(0x7fa1ec153150 msgr2=0x7fa1ec06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 --2- 172.21.15.155:0/2638136114 >> v2:172.21.15.191:3300/0 conn(0x7fa1ec153150 0x7fa1ec06f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec0c73f0 con 0x7fa1ec0c6b80 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fa1e40019f0 con 0x7fa1ec0c6b80 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 >> v1:172.21.15.155:6789/0 conn(0x7fa1ec0c6b80 legacy=0x7fa1ec0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 0x7fa1d80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d8003f30 0x7fa1d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8004d40 0x7fa1d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec0753a0 con 0x7fa1d8003f30 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d800b9c0 con 0x7fa1d8004d40 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d800bb70 con 0x7fa1ec075830 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d8003f30 0x7fa1d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1f0ca5640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8004d40 0x7fa1d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.764+0000 7fa1ebfff640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 0x7fa1d80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 msgr2=0x7fa1d80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec075830 0x7fa1d80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8004d40 msgr2=0x7fa1d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8004d40 0x7fa1d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/2638136114 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d8003520 con 0x7fa1d8003f30 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d8003f30 0x7fa1d8004800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009ac0 tx=0x7fa1d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188b903c832701d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4036070 con 0x7fa1d8003f30 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d4031400 con 0x7fa1d8003f30 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.765+0000 7fa1eaffd640 1 -- 172.21.15.155:0/2638136114 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4009690 con 0x7fa1d8003f30 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f2708640 1 -- 172.21.15.155:0/2638136114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d8003f30 msgr2=0x7fa1d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f2708640 1 --2- 172.21.15.155:0/2638136114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1d8003f30 0x7fa1d8004800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009ac0 tx=0x7fa1d8005830 comp rx=0 tx=0).stop 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f0ca5640 1 -- 172.21.15.155:0/2638136114 reap_dead start 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f2708640 1 -- 172.21.15.155:0/2638136114 shutdown_connections 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f2708640 1 -- 172.21.15.155:0/2638136114 >> 172.21.15.155:0/2638136114 conn(0x7fa1ec0ca0d0 msgr2=0x7fa1ec0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f2708640 1 -- 172.21.15.155:0/2638136114 shutdown_connections 2024-04-25T13:16:37.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.766+0000 7fa1f2708640 1 -- 172.21.15.155:0/2638136114 wait complete. 2024-04-25T13:16:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.767+0000 7fa1f2708640 1 Processor -- start 2024-04-25T13:16:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.767+0000 7fa1f2708640 1 -- start start 2024-04-25T13:16:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f2708640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8003f30 0x7fa1ec1e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f2708640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 0x7fa1ec1e0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f2708640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec1deee0 0x7fa1ec1df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f2708640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec074d50 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f2708640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec0c79b0 con 0x7fa1d8003f30 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f2708640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ec075030 con 0x7fa1ec1deee0 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 0x7fa1ec1e0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 0x7fa1ec1e0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59436/0 (socket says 172.21.15.155:59436) 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/3988456294 learned_addr learned my addr 172.21.15.155:0/3988456294 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1ebfff640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8003f30 0x7fa1ec1e56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1f0ca5640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec1deee0 0x7fa1ec1df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec1deee0 msgr2=0x7fa1ec1df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec1deee0 0x7fa1ec1df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8003f30 msgr2=0x7fa1ec1e56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8003f30 0x7fa1ec1e56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.768+0000 7fa1eb7fe640 1 -- 172.21.15.155:0/3988456294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec1df8a0 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.769+0000 7fa1eb7fe640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 0x7fa1ec1e0b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4000c00 tx=0x7fa1d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.769+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4040020 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.769+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d4003c60 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.769+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ec1f18f0 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.769+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4036040 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.769+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ec1f1e70 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.770+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ec068e40 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.770+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1d4043020 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.771+0000 7fa1e8ff9640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa1cc06c920 0x7fa1cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.771+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1d40abd20 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.771+0000 7fa1ebfff640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa1cc06c920 0x7fa1cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.771+0000 7fa1ebfff640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa1cc06c920 0x7fa1cc06ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009c40 tx=0x7fa1dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:37.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.775+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1d404a070 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.961+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa1ec0c9b80 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.962+0000 7fa1e8ff9640 1 -- 172.21.15.155:0/3988456294 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa1ec1df8a0 con 0x7fa1ec1e4fb0 2024-04-25T13:16:37.963 INFO:teuthology.orchestra.run.smithi155.stderr:listed 0 entries 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa1cc06c920 msgr2=0x7fa1cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa1cc06c920 0x7fa1cc06ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009c40 tx=0x7fa1dc009190 comp rx=0 tx=0).stop 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 msgr2=0x7fa1ec1e0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 0x7fa1ec1e0b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4000c00 tx=0x7fa1d4004730 comp rx=0 tx=0).stop 2024-04-25T13:16:37.965 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 shutdown_connections 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa1cc06c920 0x7fa1cc06ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa1ec1deee0 0x7fa1ec1df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1ec1e4fb0 0x7fa1ec1e0b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 --2- 172.21.15.155:0/3988456294 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1d8003f30 0x7fa1ec1e56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 >> 172.21.15.155:0/3988456294 conn(0x7fa1ec0ca0d0 msgr2=0x7fa1ec1569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 shutdown_connections 2024-04-25T13:16:37.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:37.964+0000 7fa1f2708640 1 -- 172.21.15.155:0/3988456294 wait complete. 2024-04-25T13:16:37.976 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:16:37.976 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:16:37.991 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:38.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.127+0000 7fc30974a640 1 Processor -- start 2024-04-25T13:16:38.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.127+0000 7fc30974a640 1 -- start start 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc30974a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc304152f10 0x7fc3040cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc30974a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc3040c9a70 0x7fc3040cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc30974a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc304158e20 con 0x7fc3040c9ff0 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc30974a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc3040c56e0 con 0x7fc3040c9a70 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc30974a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc3041599b0 con 0x7fc304152f10 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc2fbfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc3040c9a70 0x7fc3040cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc2fbfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc3040c9a70 0x7fc3040cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59452/0 (socket says 172.21.15.155:59452) 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.128+0000 7fc2fbfff640 1 -- 172.21.15.155:0/82051808 learned_addr learned my addr 172.21.15.155:0/82051808 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:38.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc302ffd640 1 --2- 172.21.15.155:0/82051808 >> v2:172.21.15.191:3300/0 conn(0x7fc304152f10 0x7fc3040cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc2fbfff640 1 -- 172.21.15.155:0/82051808 >> v2:172.21.15.191:3300/0 conn(0x7fc304152f10 msgr2=0x7fc3040cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc2fbfff640 1 --2- 172.21.15.155:0/82051808 >> v2:172.21.15.191:3300/0 conn(0x7fc304152f10 0x7fc3040cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc2fbfff640 1 -- 172.21.15.155:0/82051808 >> v1:172.21.15.191:6789/0 conn(0x7fc3040c9ff0 legacy=0x7fc3040c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc2fbfff640 1 -- 172.21.15.155:0/82051808 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3041590c0 con 0x7fc3040c9a70 2024-04-25T13:16:38.131 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc302ffd640 1 --2- 172.21.15.155:0/82051808 >> v2:172.21.15.191:3300/0 conn(0x7fc304152f10 0x7fc3040cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.129+0000 7fc2fbfff640 1 --2- 172.21.15.155:0/82051808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc3040cdf40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc304159b30 tx=0x7fc2ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108ccca8d56df67b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc3027fc640 1 -- 172.21.15.155:0/82051808 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec037070 con 0x7fc3040c9a70 2024-04-25T13:16:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc3027fc640 1 -- 172.21.15.155:0/82051808 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec032440 con 0x7fc3040c9a70 2024-04-25T13:16:38.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc3027fc640 1 -- 172.21.15.155:0/82051808 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec032810 con 0x7fc3040c9a70 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 -- 172.21.15.155:0/82051808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 msgr2=0x7fc3040cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 --2- 172.21.15.155:0/82051808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc3040cdf40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc304159b30 tx=0x7fc2ec02a210 comp rx=0 tx=0).stop 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 -- 172.21.15.155:0/82051808 shutdown_connections 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 --2- 172.21.15.155:0/82051808 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc3040cdf40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 --2- 172.21.15.155:0/82051808 >> v2:172.21.15.191:3300/0 conn(0x7fc304152f10 0x7fc3040cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 -- 172.21.15.155:0/82051808 >> 172.21.15.155:0/82051808 conn(0x7fc30406b920 msgr2=0x7fc30406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 -- 172.21.15.155:0/82051808 shutdown_connections 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.130+0000 7fc30974a640 1 -- 172.21.15.155:0/82051808 wait complete. 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.131+0000 7fc30974a640 1 Processor -- start 2024-04-25T13:16:38.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.131+0000 7fc30974a640 1 -- start start 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc30974a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc30415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc30974a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040c9ff0 0x7fc3041eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc30974a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304152f10 0x7fc3041ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc30974a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc304159640 con 0x7fc3040c9a70 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc30974a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc304159360 con 0x7fc3040c9ff0 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc30974a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc3041532f0 con 0x7fc304152f10 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc30415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc30415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59462/0 (socket says 172.21.15.155:59462) 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 -- 172.21.15.155:0/4289933205 learned_addr learned my addr 172.21.15.155:0/4289933205 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc2fbfff640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040c9ff0 0x7fc3041eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc3037fe640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304152f10 0x7fc3041ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 -- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304152f10 msgr2=0x7fc3041ef410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304152f10 0x7fc3041ef410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 -- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040c9ff0 msgr2=0x7fc3041eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040c9ff0 0x7fc3041eeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.132+0000 7fc302ffd640 1 -- 172.21.15.155:0/4289933205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30415c570 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.133+0000 7fc302ffd640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc30415c9d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c7f0 tx=0x7fc2f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.133+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4015070 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.133+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f4007820 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.133+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3041555e0 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.133+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4007bd0 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.133+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc304155880 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.134+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3040cdf40 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.134+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2f4018070 con 0x7fc3040c9a70 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.134+0000 7fc2fb7fe640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc2e406c8f0 0x7fc2e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.135+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2f408bf30 con 0x7fc3040c9a70 2024-04-25T13:16:38.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.135+0000 7fc2fbfff640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc2e406c8f0 0x7fc2e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.138 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.135+0000 7fc2fbfff640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc2e406c8f0 0x7fc2e406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec034000 tx=0x7fc2ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.139 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.139+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc3040cdf40 con 0x7fc3040c9a70 2024-04-25T13:16:38.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.313+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc304068e40 con 0x7fc3040c9a70 2024-04-25T13:16:38.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.314+0000 7fc2fb7fe640 1 -- 172.21.15.155:0/4289933205 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7fc2f4059940 con 0x7fc3040c9a70 2024-04-25T13:16:38.316 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:38.316 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.316+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc2e406c8f0 msgr2=0x7fc2e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.316+0000 7fc30974a640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc2e406c8f0 0x7fc2e406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec034000 tx=0x7fc2ec02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.316+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 msgr2=0x7fc30415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.316+0000 7fc30974a640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc30415c9d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400c7f0 tx=0x7fc2f400ccb0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 shutdown_connections 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc2e406c8f0 0x7fc2e406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc304152f10 0x7fc3041ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc3040c9ff0 0x7fc3041eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 --2- 172.21.15.155:0/4289933205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3040c9a70 0x7fc30415c9d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 >> 172.21.15.155:0/4289933205 conn(0x7fc30406b920 msgr2=0x7fc3040c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 shutdown_connections 2024-04-25T13:16:38.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.317+0000 7fc30974a640 1 -- 172.21.15.155:0/4289933205 wait complete. 2024-04-25T13:16:38.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:19.529860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:19.949095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:23.675819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:16:38.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:16:38.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.429+0000 7f373fbbb640 1 Processor -- start 2024-04-25T13:16:38.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.429+0000 7f373fbbb640 1 -- start start 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.429+0000 7f373fbbb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37380cb5c0 0x7f373806f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373fbbb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f37380cae40 0x7f373815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373fbbb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f373806fd30 con 0x7f37380cb9a0 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373fbbb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f37380c9d90 con 0x7f37380cb5c0 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373fbbb640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f37380ca070 con 0x7f37380cae40 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37380cb5c0 0x7f373806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f37380cb5c0 0x7f373806f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59478/0 (socket says 172.21.15.155:59478) 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 -- 172.21.15.155:0/1838311839 learned_addr learned my addr 172.21.15.155:0/1838311839 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d156640 1 --2- 172.21.15.155:0/1838311839 >> v2:172.21.15.191:3300/0 conn(0x7f37380cae40 0x7f373815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 -- 172.21.15.155:0/1838311839 >> v2:172.21.15.191:3300/0 conn(0x7f37380cae40 msgr2=0x7f373815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 --2- 172.21.15.155:0/1838311839 >> v2:172.21.15.191:3300/0 conn(0x7f37380cae40 0x7f373815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 -- 172.21.15.155:0/1838311839 >> v1:172.21.15.191:6789/0 conn(0x7f37380cb9a0 legacy=0x7f3738154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.430+0000 7f373d957640 1 -- 172.21.15.155:0/1838311839 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37380ca350 con 0x7f37380cb5c0 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373d957640 1 --2- 172.21.15.155:0/1838311839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cb5c0 0x7f373806f380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3728009870 tx=0x7f372802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d1f5ae1f900ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373c955640 1 -- 172.21.15.155:0/1838311839 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728037070 con 0x7f37380cb5c0 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373c955640 1 -- 172.21.15.155:0/1838311839 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728032440 con 0x7f37380cb5c0 2024-04-25T13:16:38.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373c955640 1 -- 172.21.15.155:0/1838311839 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728032810 con 0x7f37380cb5c0 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 -- 172.21.15.155:0/1838311839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cb5c0 msgr2=0x7f373806f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 --2- 172.21.15.155:0/1838311839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cb5c0 0x7f373806f380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3728009870 tx=0x7f372802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 -- 172.21.15.155:0/1838311839 shutdown_connections 2024-04-25T13:16:38.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 --2- 172.21.15.155:0/1838311839 >> v2:172.21.15.191:3300/0 conn(0x7f37380cae40 0x7f373815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 --2- 172.21.15.155:0/1838311839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cb5c0 0x7f373806f380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 -- 172.21.15.155:0/1838311839 >> 172.21.15.155:0/1838311839 conn(0x7f3738074d50 msgr2=0x7f3738075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.431+0000 7f373fbbb640 1 -- 172.21.15.155:0/1838311839 shutdown_connections 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.432+0000 7f373fbbb640 1 -- 172.21.15.155:0/1838311839 wait complete. 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 Processor -- start 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 -- start start 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 0x7f37381f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37380cb5c0 0x7f37380cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37380cb9a0 0x7f37380cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f373806c450 con 0x7f37380cae40 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f37380ca910 con 0x7f37380cb9a0 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373fbbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f373806c5d0 con 0x7f37380cb5c0 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373d957640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 0x7f37381f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373d957640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 0x7f37381f1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59492/0 (socket says 172.21.15.155:59492) 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.433+0000 7f373d957640 1 -- 172.21.15.155:0/2294498703 learned_addr learned my addr 172.21.15.155:0/2294498703 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373e158640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37380cb9a0 0x7f37380cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373d957640 1 -- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37380cb5c0 msgr2=0x7f37380cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373d957640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37380cb5c0 0x7f37380cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373d957640 1 -- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37380cb9a0 msgr2=0x7f37380cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373d957640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37380cb9a0 0x7f37380cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373d957640 1 -- 172.21.15.155:0/2294498703 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37380cc6c0 con 0x7f37380cae40 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373e158640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37380cb9a0 0x7f37380cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373d957640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 0x7f37381f1170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f37280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728037040 con 0x7f37380cae40 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728004230 con 0x7f37380cae40 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37380cc980 con 0x7f37380cae40 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372803c670 con 0x7f37380cae40 2024-04-25T13:16:38.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.434+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37380ccf40 con 0x7f37380cae40 2024-04-25T13:16:38.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.435+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3738068f50 con 0x7f37380cae40 2024-04-25T13:16:38.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.436+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f372803a070 con 0x7f37380cae40 2024-04-25T13:16:38.438 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.436+0000 7f372e7fc640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f371c06c8f0 0x7f371c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.436+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f37280ac790 con 0x7f37380cae40 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.436+0000 7f373d156640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f371c06c8f0 0x7f371c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.439 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.437+0000 7f373d156640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f371c06c8f0 0x7f371c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37381518b0 tx=0x7f3734008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.441+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3728041020 con 0x7f37380cae40 2024-04-25T13:16:38.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.613+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3738159b10 con 0x7f37380cae40 2024-04-25T13:16:38.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.614+0000 7f372e7fc640 1 -- 172.21.15.155:0/2294498703 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f372807a7f0 con 0x7f37380cae40 2024-04-25T13:16:38.615 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f371c06c8f0 msgr2=0x7f371c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f371c06c8f0 0x7f371c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37381518b0 tx=0x7f3734008040 comp rx=0 tx=0).stop 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 msgr2=0x7f37381f1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 0x7f37381f1170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f37280046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 shutdown_connections 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37380cb9a0 0x7f37380cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f371c06c8f0 0x7f371c06edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f37380cb5c0 0x7f37380cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 --2- 172.21.15.155:0/2294498703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37380cae40 0x7f37381f1170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.617 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 >> 172.21.15.155:0/2294498703 conn(0x7f3738074d50 msgr2=0x7f373815ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 shutdown_connections 2024-04-25T13:16:38.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.616+0000 7f373fbbb640 1 -- 172.21.15.155:0/2294498703 wait complete. 2024-04-25T13:16:38.628 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.728+0000 7f46ffb95640 1 Processor -- start 2024-04-25T13:16:38.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.728+0000 7f46ffb95640 1 -- start start 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46ffb95640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f46f8074fc0 0x7f46f8072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46ffb95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46f8155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46ffb95640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f81555d0 con 0x7f46f80753a0 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46ffb95640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f46f815b100 con 0x7f46f8074fc0 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46ffb95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f46f815b3c0 con 0x7f46f8154c40 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fd130640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f46f80753a0 0x7f46f8070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35922/0 (socket says 172.21.15.155:35922) 2024-04-25T13:16:38.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fd130640 1 -- 172.21.15.155:0/3258513926 learned_addr learned my addr 172.21.15.155:0/3258513926 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213589141 0 0) 0x7f46f81555d0 con 0x7f46f80753a0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e4003520 con 0x7f46f80753a0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fd931640 1 --2- 172.21.15.155:0/3258513926 >> v2:172.21.15.191:3300/0 conn(0x7f46f8074fc0 0x7f46f8072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fe132640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46f8155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1777011256 0 0) 0x7f46e4003520 con 0x7f46f80753a0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 msgr2=0x7f46f8155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46f8155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 >> v2:172.21.15.191:3300/0 conn(0x7f46f8074fc0 msgr2=0x7f46f8072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 --2- 172.21.15.155:0/3258513926 >> v2:172.21.15.191:3300/0 conn(0x7f46f8074fc0 0x7f46f8072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f815b6a0 con 0x7f46f80753a0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f46e8001670 con 0x7f46f80753a0 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 >> v1:172.21.15.155:6789/0 conn(0x7f46f80753a0 legacy=0x7f46f8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e40039b0 0x7f46e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.733 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e4004800 0x7f46e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46f815b100 con 0x7f46e40039b0 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f46f815b3c0 con 0x7f46e4004800 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f46e400b9f0 con 0x7f46f8154c40 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fd931640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e40039b0 0x7f46e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.729+0000 7f46fd130640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e4004800 0x7f46e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fe132640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fd931640 1 -- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 msgr2=0x7f46e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fd931640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fd931640 1 -- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e4004800 msgr2=0x7f46e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fd931640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e4004800 0x7f46e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fd931640 1 -- 172.21.15.155:0/3258513926 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4003520 con 0x7f46e40039b0 2024-04-25T13:16:38.734 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fe132640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f8154c40 0x7f46e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.730+0000 7f46fd931640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e40039b0 0x7f46e4003dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009ac0 tx=0x7f46e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9efa93162df0f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4036070 con 0x7f46e40039b0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f4031400 con 0x7f46e40039b0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46fc92f640 1 -- 172.21.15.155:0/3258513926 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4009690 con 0x7f46e40039b0 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46ffb95640 1 -- 172.21.15.155:0/3258513926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e40039b0 msgr2=0x7f46e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46ffb95640 1 --2- 172.21.15.155:0/3258513926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e40039b0 0x7f46e4003dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009ac0 tx=0x7f46e4005830 comp rx=0 tx=0).stop 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46fe132640 1 -- 172.21.15.155:0/3258513926 reap_dead start 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46ffb95640 1 -- 172.21.15.155:0/3258513926 shutdown_connections 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46ffb95640 1 -- 172.21.15.155:0/3258513926 >> 172.21.15.155:0/3258513926 conn(0x7f46f806b920 msgr2=0x7f46f806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46ffb95640 1 -- 172.21.15.155:0/3258513926 shutdown_connections 2024-04-25T13:16:38.735 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.731+0000 7f46ffb95640 1 -- 172.21.15.155:0/3258513926 wait complete. 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.732+0000 7f46ffb95640 1 Processor -- start 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.732+0000 7f46ffb95640 1 -- start start 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46ffb95640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e40039b0 0x7f46f80cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46ffb95640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f80cd450 0x7f46f81f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46ffb95640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 0x7f46f814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46ffb95640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8070b50 con 0x7f46f80c6340 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46ffb95640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f46f815bc60 con 0x7f46e40039b0 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46ffb95640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f46f8070cd0 con 0x7f46f80cd450 2024-04-25T13:16:38.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 0x7f46f814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 0x7f46f814d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59512/0 (socket says 172.21.15.155:59512) 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 -- 172.21.15.155:0/1284523415 learned_addr learned my addr 172.21.15.155:0/1284523415 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fd931640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e40039b0 0x7f46f80cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fd130640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f80cd450 0x7f46f81f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 -- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f80cd450 msgr2=0x7f46f81f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f80cd450 0x7f46f81f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 -- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e40039b0 msgr2=0x7f46f80cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.733+0000 7f46fe132640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e40039b0 0x7f46f80cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46fe132640 1 -- 172.21.15.155:0/1284523415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f81f5120 con 0x7f46f80c6340 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46fe132640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 0x7f46f814d3d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46f80cb540 tx=0x7f46f0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0010e30 con 0x7f46f80c6340 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f0003990 con 0x7f46f80c6340 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f80c4cc0 con 0x7f46f80c6340 2024-04-25T13:16:38.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0003dc0 con 0x7f46f80c6340 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.734+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f815c7f0 con 0x7f46f80c6340 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.735+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f8068e40 con 0x7f46f80c6340 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.735+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46f001e020 con 0x7f46f80c6340 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.736+0000 7f46ee7fc640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f46dc06c8f0 0x7f46dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.736+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46f008c510 con 0x7f46f80c6340 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.736+0000 7f46fd931640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f46dc06c8f0 0x7f46dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:38.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.736+0000 7f46fd931640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f46dc06c8f0 0x7f46dc06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46f4033000 tx=0x7f46f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:38.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.740+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46f005a570 con 0x7f46f80c6340 2024-04-25T13:16:38.915 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.914+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f46f80c48c0 con 0x7f46f80c6340 2024-04-25T13:16:38.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.915+0000 7f46ee7fc640 1 -- 172.21.15.155:0/1284523415 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f46f0059e70 con 0x7f46f80c6340 2024-04-25T13:16:38.916 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f46dc06c8f0 msgr2=0x7f46dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f46dc06c8f0 0x7f46dc06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46f4033000 tx=0x7f46f4008030 comp rx=0 tx=0).stop 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 msgr2=0x7f46f814d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 0x7f46f814d3d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46f80cb540 tx=0x7f46f0010590 comp rx=0 tx=0).stop 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 shutdown_connections 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46f80c6340 0x7f46f814d3d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f46dc06c8f0 0x7f46dc06edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f46f80cd450 0x7f46f81f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 --2- 172.21.15.155:0/1284523415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46e40039b0 0x7f46f80cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:38.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 >> 172.21.15.155:0/1284523415 conn(0x7f46f806b920 msgr2=0x7f46f8072e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:38.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 shutdown_connections 2024-04-25T13:16:38.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:38.917+0000 7f46ffb95640 1 -- 172.21.15.155:0/1284523415 wait complete. 2024-04-25T13:16:38.928 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 Processor -- start 2024-04-25T13:16:39.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 -- start start 2024-04-25T13:16:39.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f56f0155710 0x7f56f00cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f56f006cf90 0x7f56f00c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f015eaa0 con 0x7f56f00cbf50 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f56f00c8940 con 0x7f56f0155710 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56f6413640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f56f0155af0 con 0x7f56f006cf90 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.028+0000 7f56effff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f56f0155710 0x7f56f00cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56effff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f56f0155710 0x7f56f00cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59516/0 (socket says 172.21.15.155:59516) 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56effff640 1 -- 172.21.15.155:0/1261054342 learned_addr learned my addr 172.21.15.155:0/1261054342 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56f49b0640 1 --2- 172.21.15.155:0/1261054342 >> v2:172.21.15.191:3300/0 conn(0x7f56f006cf90 0x7f56f00c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56effff640 1 -- 172.21.15.155:0/1261054342 >> v2:172.21.15.191:3300/0 conn(0x7f56f006cf90 msgr2=0x7f56f00c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56effff640 1 --2- 172.21.15.155:0/1261054342 >> v2:172.21.15.191:3300/0 conn(0x7f56f006cf90 0x7f56f00c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56effff640 1 -- 172.21.15.155:0/1261054342 >> v1:172.21.15.191:6789/0 conn(0x7f56f00cbf50 legacy=0x7f56f006c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.029+0000 7f56effff640 1 -- 172.21.15.155:0/1261054342 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f015ed80 con 0x7f56f0155710 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56effff640 1 --2- 172.21.15.155:0/1261054342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f00cba10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56f0072f80 tx=0x7f56e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8574ac0747ee76c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56eeffd640 1 -- 172.21.15.155:0/1261054342 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0037070 con 0x7f56f0155710 2024-04-25T13:16:39.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56eeffd640 1 -- 172.21.15.155:0/1261054342 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e0032440 con 0x7f56f0155710 2024-04-25T13:16:39.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56eeffd640 1 -- 172.21.15.155:0/1261054342 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0032810 con 0x7f56f0155710 2024-04-25T13:16:39.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 -- 172.21.15.155:0/1261054342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 msgr2=0x7f56f00cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 --2- 172.21.15.155:0/1261054342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f00cba10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56f0072f80 tx=0x7f56e002a270 comp rx=0 tx=0).stop 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 -- 172.21.15.155:0/1261054342 shutdown_connections 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 --2- 172.21.15.155:0/1261054342 >> v2:172.21.15.191:3300/0 conn(0x7f56f006cf90 0x7f56f00c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 --2- 172.21.15.155:0/1261054342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f00cba10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 -- 172.21.15.155:0/1261054342 >> 172.21.15.155:0/1261054342 conn(0x7f56f00731d0 msgr2=0x7f56f00735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 -- 172.21.15.155:0/1261054342 shutdown_connections 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.030+0000 7f56f6413640 1 -- 172.21.15.155:0/1261054342 wait complete. 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.031+0000 7f56f6413640 1 Processor -- start 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 -- start start 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56f006cf90 0x7f56f01f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56f00cbf50 0x7f56f014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f56f015f340 con 0x7f56f0155710 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f56f015f6b0 con 0x7f56f00cbf50 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f6413640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f56f00ccb10 con 0x7f56f006cf90 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f49b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f49b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f014c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59530/0 (socket says 172.21.15.155:59530) 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.032+0000 7f56f49b0640 1 -- 172.21.15.155:0/1222962805 learned_addr learned my addr 172.21.15.155:0/1222962805 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56ef7fe640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56f00cbf50 0x7f56f014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f49b0640 1 -- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56f006cf90 msgr2=0x7f56f01f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56effff640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56f006cf90 0x7f56f01f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f49b0640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56f006cf90 0x7f56f01f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f49b0640 1 -- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56f00cbf50 msgr2=0x7f56f014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f49b0640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56f00cbf50 0x7f56f014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f49b0640 1 -- 172.21.15.155:0/1222962805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f01e4b60 con 0x7f56f0155710 2024-04-25T13:16:39.036 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56ef7fe640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56f00cbf50 0x7f56f014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56effff640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56f006cf90 0x7f56f01f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f49b0640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f014c610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f56e800efc0 tx=0x7f56e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8018020 con 0x7f56f0155710 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8014480 con 0x7f56f0155710 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f01e4e40 con 0x7f56f0155710 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8014870 con 0x7f56f0155710 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.033+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f01f16d0 con 0x7f56f0155710 2024-04-25T13:16:39.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.034+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f01466b0 con 0x7f56f0155710 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.034+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56e8005d10 con 0x7f56f0155710 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.035+0000 7f56ecff9640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f56dc06c8f0 0x7f56dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.035+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f56e808cc70 con 0x7f56f0155710 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.035+0000 7f56effff640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f56dc06c8f0 0x7f56dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.035+0000 7f56effff640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f56dc06c8f0 0x7f56dc06edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f56e0034000 tx=0x7f56e002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.039+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56f01466b0 con 0x7f56f0155710 2024-04-25T13:16:39.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.214+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56f0068f50 con 0x7f56f0155710 2024-04-25T13:16:39.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.214+0000 7f56ecff9640 1 -- 172.21.15.155:0/1222962805 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f56e8022030 con 0x7f56f0155710 2024-04-25T13:16:39.215 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-04-25T13:16:39.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f56dc06c8f0 msgr2=0x7f56dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f56dc06c8f0 0x7f56dc06edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f56e0034000 tx=0x7f56e002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:39.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 msgr2=0x7f56f014c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f014c610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f56e800efc0 tx=0x7f56e800c490 comp rx=0 tx=0).stop 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 shutdown_connections 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56f0155710 0x7f56f014c610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56f00cbf50 0x7f56f014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f56dc06c8f0 0x7f56dc06edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 --2- 172.21.15.155:0/1222962805 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f56f006cf90 0x7f56f01f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 >> 172.21.15.155:0/1222962805 conn(0x7f56f00731d0 msgr2=0x7f56f01548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 shutdown_connections 2024-04-25T13:16:39.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.216+0000 7f56f6413640 1 -- 172.21.15.155:0/1222962805 wait complete. 2024-04-25T13:16:39.228 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:16:39.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.327+0000 7f110c722640 1 Processor -- start 2024-04-25T13:16:39.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.327+0000 7f110c722640 1 -- start start 2024-04-25T13:16:39.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110c722640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f11040c36a0 0x7f11040cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110c722640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11040727b0 0x7f11040ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110c722640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11040c84e0 con 0x7f11041520e0 2024-04-25T13:16:39.329 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110c722640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f11040c77b0 con 0x7f11040727b0 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110c722640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f11040c82b0 con 0x7f11040c36a0 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11040727b0 0x7f11040ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f11040727b0 0x7f11040ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59546/0 (socket says 172.21.15.155:59546) 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 -- 172.21.15.155:0/1943891255 learned_addr learned my addr 172.21.15.155:0/1943891255 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f1109cbd640 1 --2- 172.21.15.155:0/1943891255 >> v2:172.21.15.191:3300/0 conn(0x7f11040c36a0 0x7f11040cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 -- 172.21.15.155:0/1943891255 >> v2:172.21.15.191:3300/0 conn(0x7f11040c36a0 msgr2=0x7f11040cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 --2- 172.21.15.155:0/1943891255 >> v2:172.21.15.191:3300/0 conn(0x7f11040c36a0 0x7f11040cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 -- 172.21.15.155:0/1943891255 >> v1:172.21.15.191:6789/0 conn(0x7f11041520e0 legacy=0x7f11040c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f110acbf640 1 -- 172.21.15.155:0/1943891255 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11040c87c0 con 0x7f11040727b0 2024-04-25T13:16:39.330 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.328+0000 7f1109cbd640 1 --2- 172.21.15.155:0/1943891255 >> v2:172.21.15.191:3300/0 conn(0x7f11040c36a0 0x7f11040cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.329+0000 7f110acbf640 1 --2- 172.21.15.155:0/1943891255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11040727b0 0x7f11040ccb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f110406ff10 tx=0x7f10fc02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42beecf27e71e0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.329+0000 7f11094bc640 1 -- 172.21.15.155:0/1943891255 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00b2e0 con 0x7f11040727b0 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.329+0000 7f11094bc640 1 -- 172.21.15.155:0/1943891255 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc037070 con 0x7f11040727b0 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.329+0000 7f11094bc640 1 -- 172.21.15.155:0/1943891255 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00b480 con 0x7f11040727b0 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.329+0000 7f110c722640 1 -- 172.21.15.155:0/1943891255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11040727b0 msgr2=0x7f11040ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.329+0000 7f110c722640 1 --2- 172.21.15.155:0/1943891255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11040727b0 0x7f11040ccb30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f110406ff10 tx=0x7f10fc02c940 comp rx=0 tx=0).stop 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.330+0000 7f110c722640 1 -- 172.21.15.155:0/1943891255 shutdown_connections 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.330+0000 7f110c722640 1 --2- 172.21.15.155:0/1943891255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11040727b0 0x7f11040ccb30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.330+0000 7f110c722640 1 --2- 172.21.15.155:0/1943891255 >> v2:172.21.15.191:3300/0 conn(0x7f11040c36a0 0x7f11040cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.330+0000 7f110c722640 1 -- 172.21.15.155:0/1943891255 >> 172.21.15.155:0/1943891255 conn(0x7f1104068360 msgr2=0x7f1104074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.330+0000 7f110c722640 1 -- 172.21.15.155:0/1943891255 shutdown_connections 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.330+0000 7f110c722640 1 -- 172.21.15.155:0/1943891255 wait complete. 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 Processor -- start 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 -- start start 2024-04-25T13:16:39.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11040727b0 0x7f1104148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11040c36a0 0x7f11041f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 0x7f110414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f110415b580 con 0x7f11041520e0 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f11041524c0 con 0x7f11040c36a0 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110c722640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f110415b860 con 0x7f11040727b0 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.331+0000 7f110acbf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 0x7f110414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 0x7f110414fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59554/0 (socket says 172.21.15.155:59554) 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 -- 172.21.15.155:0/1625957027 learned_addr learned my addr 172.21.15.155:0/1625957027 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f1109cbd640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11040c36a0 0x7f11041f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 -- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11040727b0 msgr2=0x7f1104148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11040727b0 0x7f1104148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 -- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11040c36a0 msgr2=0x7f11041f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11040c36a0 0x7f11041f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 -- 172.21.15.155:0/1625957027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11041494b0 con 0x7f11041520e0 2024-04-25T13:16:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110acbf640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 0x7f110414fac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00d240 tx=0x7f10fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc03f070 con 0x7f11041520e0 2024-04-25T13:16:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10fc032860 con 0x7f11041520e0 2024-04-25T13:16:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11041e3690 con 0x7f11041520e0 2024-04-25T13:16:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00b720 con 0x7f11041520e0 2024-04-25T13:16:39.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.332+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11041f4260 con 0x7f11041520e0 2024-04-25T13:16:39.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.333+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1104068e40 con 0x7f11041520e0 2024-04-25T13:16:39.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.333+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10fc005d10 con 0x7f11041520e0 2024-04-25T13:16:39.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.334+0000 7f10faffd640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f10e806c8f0 0x7f10e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.334+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f10fc0ad0b0 con 0x7f11041520e0 2024-04-25T13:16:39.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.334+0000 7f110a4be640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f10e806c8f0 0x7f10e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.337 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.334+0000 7f110a4be640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f10e806c8f0 0x7f10e806edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1100000f60 tx=0x7f11000079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.339 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.338+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10fc07b230 con 0x7f11041520e0 2024-04-25T13:16:39.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.513+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f11040ccd60 con 0x7f11041520e0 2024-04-25T13:16:39.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.513+0000 7f10faffd640 1 -- 172.21.15.155:0/1625957027 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f10fc07ab30 con 0x7f11041520e0 2024-04-25T13:16:39.515 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:16:39.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f10e806c8f0 msgr2=0x7f10e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f10e806c8f0 0x7f10e806edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1100000f60 tx=0x7f11000079d0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 msgr2=0x7f110414fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 0x7f110414fac0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00d240 tx=0x7f10fc004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 shutdown_connections 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f11041520e0 0x7f110414fac0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f11040c36a0 0x7f11041f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f10e806c8f0 0x7f10e806edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 --2- 172.21.15.155:0/1625957027 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f11040727b0 0x7f1104148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 >> 172.21.15.155:0/1625957027 conn(0x7f1104068360 msgr2=0x7f1104150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.515+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 shutdown_connections 2024-04-25T13:16:39.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.516+0000 7f110c722640 1 -- 172.21.15.155:0/1625957027 wait complete. 2024-04-25T13:16:39.528 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:16:39.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.624+0000 7fc55b2ae640 1 Processor -- start 2024-04-25T13:16:39.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.625+0000 7fc55b2ae640 1 -- start start 2024-04-25T13:16:39.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.625+0000 7fc55b2ae640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5541553a0 0x7fc5540c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.625+0000 7fc55b2ae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc55415bb80 0x7fc5540c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.625+0000 7fc55b2ae640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55406c850 con 0x7fc5540c8070 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.625+0000 7fc55b2ae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc55406cb30 con 0x7fc55415bb80 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.625+0000 7fc55b2ae640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc55406ce10 con 0x7fc5541553a0 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55984b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc55415bb80 0x7fc5540c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc558849640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fc5540c8070 0x7fc5540ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35932/0 (socket says 172.21.15.155:35932) 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc558849640 1 -- 172.21.15.155:0/1306819014 learned_addr learned my addr 172.21.15.155:0/1306819014 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55904a640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5541553a0 0x7fc5540c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55984b640 1 -- 172.21.15.155:0/1306819014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5541553a0 msgr2=0x7fc5540c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55984b640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5541553a0 0x7fc5540c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55984b640 1 -- 172.21.15.155:0/1306819014 >> v1:172.21.15.155:6789/0 conn(0x7fc5540c8070 legacy=0x7fc5540ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55984b640 1 -- 172.21.15.155:0/1306819014 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55406d0f0 con 0x7fc55415bb80 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc54bfff640 1 -- 172.21.15.155:0/1306819014 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184587324 0 0) 0x7fc55406c850 con 0x7fc5540c8070 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55904a640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5541553a0 0x7fc5540c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.626+0000 7fc55984b640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc55415bb80 0x7fc5540c8c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009d90 tx=0x7fc54c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3570d24c2e62ec9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc54bfff640 1 -- 172.21.15.155:0/1306819014 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c007740 con 0x7fc55415bb80 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc54bfff640 1 -- 172.21.15.155:0/1306819014 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0078e0 con 0x7fc55415bb80 2024-04-25T13:16:39.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc54bfff640 1 -- 172.21.15.155:0/1306819014 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c007cb0 con 0x7fc55415bb80 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 -- 172.21.15.155:0/1306819014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc55415bb80 msgr2=0x7fc5540c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc55415bb80 0x7fc5540c8c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009d90 tx=0x7fc54c02a6f0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 -- 172.21.15.155:0/1306819014 shutdown_connections 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc55415bb80 0x7fc5540c8c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/1306819014 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5541553a0 0x7fc5540c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 -- 172.21.15.155:0/1306819014 >> 172.21.15.155:0/1306819014 conn(0x7fc554073010 msgr2=0x7fc554073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 -- 172.21.15.155:0/1306819014 shutdown_connections 2024-04-25T13:16:39.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.627+0000 7fc55b2ae640 1 -- 172.21.15.155:0/1306819014 wait complete. 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.628+0000 7fc55b2ae640 1 Processor -- start 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.628+0000 7fc55b2ae640 1 -- start start 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55b2ae640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5540c8070 0x7fc5540d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55b2ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 0x7fc5541f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55b2ae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc55415bb80 0x7fc5541f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55b2ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5540cd4d0 con 0x7fc5541553a0 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55b2ae640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc554155780 con 0x7fc55415bb80 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55b2ae640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc5540cd650 con 0x7fc5540c8070 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc558849640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 0x7fc5541f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc558849640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 0x7fc5541f42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59570/0 (socket says 172.21.15.155:59570) 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc558849640 1 -- 172.21.15.155:0/3940263957 learned_addr learned my addr 172.21.15.155:0/3940263957 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55904a640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5540c8070 0x7fc5540d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.629+0000 7fc55984b640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc55415bb80 0x7fc5541f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc558849640 1 -- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5540c8070 msgr2=0x7fc5540d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc558849640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5540c8070 0x7fc5540d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc558849640 1 -- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc55415bb80 msgr2=0x7fc5541f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc558849640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc55415bb80 0x7fc5541f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc558849640 1 -- 172.21.15.155:0/3940263957 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5540cfe50 con 0x7fc5541553a0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc558849640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 0x7fc5541f42b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc54400c4a0 tx=0x7fc54400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544018070 con 0x7fc5541553a0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5440074e0 con 0x7fc5541553a0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5541f4e10 con 0x7fc5541553a0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc544004a20 con 0x7fc5541553a0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.630+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5540cfb70 con 0x7fc5541553a0 2024-04-25T13:16:39.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.631+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc554068e40 con 0x7fc5541553a0 2024-04-25T13:16:39.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.632+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc54401b070 con 0x7fc5541553a0 2024-04-25T13:16:39.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.632+0000 7fc549ffb640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53806c920 0x7fc53806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:39.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.632+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc54408b080 con 0x7fc5541553a0 2024-04-25T13:16:39.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.632+0000 7fc55904a640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53806c920 0x7fc53806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:39.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.632+0000 7fc55904a640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53806c920 0x7fc53806ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc550006fd0 tx=0x7fc550008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:39.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.636+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5540cfe50 con 0x7fc5541553a0 2024-04-25T13:16:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.823+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc5540c9860 con 0x7fc5541553a0 2024-04-25T13:16:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.823+0000 7fc549ffb640 1 -- 172.21.15.155:0/3940263957 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fc544058bb0 con 0x7fc5541553a0 2024-04-25T13:16:39.824 INFO:teuthology.orchestra.run.smithi155.stderr:listed 0 entries 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53806c920 msgr2=0x7fc53806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53806c920 0x7fc53806ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc550006fd0 tx=0x7fc550008040 comp rx=0 tx=0).stop 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 msgr2=0x7fc5541f42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 0x7fc5541f42b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc54400c4a0 tx=0x7fc54400c960 comp rx=0 tx=0).stop 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 shutdown_connections 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc55415bb80 0x7fc5541f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5541553a0 0x7fc5541f42b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc53806c920 0x7fc53806ede0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 --2- 172.21.15.155:0/3940263957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc5540c8070 0x7fc5540d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 >> 172.21.15.155:0/3940263957 conn(0x7fc554073010 msgr2=0x7fc554154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 shutdown_connections 2024-04-25T13:16:39.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:39.826+0000 7fc55b2ae640 1 -- 172.21.15.155:0/3940263957 wait complete. 2024-04-25T13:16:39.837 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-04-25T13:16:39.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:39.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T13:16:39.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi155.stderr:ceph-fuse[42436]: fuse finished with error 0 and tester_r 0 2024-04-25T13:16:39.861 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:16:41.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:41.778 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:16:45.962 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:16:45.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:16:45.962 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T13:16:46.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:46.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.207+0000 7fee62cfa640 1 Processor -- start 2024-04-25T13:16:46.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.207+0000 7fee62cfa640 1 -- start start 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee62cfa640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fee5c144270 0x7fee5c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee62cfa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c8e70 0x7fee5c074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee62cfa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee5c144650 con 0x7fee5c0c9290 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee62cfa640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c15f4e0 con 0x7fee5c144270 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee62cfa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c0ce080 con 0x7fee5c0c8e70 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee61297640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fee5c0c9290 0x7fee5c075290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48512/0 (socket says 172.21.15.155:48512) 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee61297640 1 -- 172.21.15.155:0/507017311 learned_addr learned my addr 172.21.15.155:0/507017311 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:46.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5bfff640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c8e70 0x7fee5c074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee60a96640 1 --2- 172.21.15.155:0/507017311 >> v2:172.21.15.191:3300/0 conn(0x7fee5c144270 0x7fee5c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819090426 0 0) 0x7fee5c144650 con 0x7fee5c0c9290 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee4c003520 con 0x7fee5c0c9290 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4111949959 0 0) 0x7fee4c003520 con 0x7fee5c0c9290 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c8e70 msgr2=0x7fee5c074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c8e70 0x7fee5c074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 >> v2:172.21.15.191:3300/0 conn(0x7fee5c144270 msgr2=0x7fee5c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 --2- 172.21.15.155:0/507017311 >> v2:172.21.15.191:3300/0 conn(0x7fee5c144270 0x7fee5c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c15b0b0 con 0x7fee5c0c9290 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fee540019f0 con 0x7fee5c0c9290 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 >> v1:172.21.15.155:6789/0 conn(0x7fee5c0c9290 legacy=0x7fee5c075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.208+0000 7fee5b7fe640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5b7fe640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5b7fe640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c15f4e0 con 0x7fee4c0051c0 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c0ce080 con 0x7fee4c0039b0 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c00bf00 con 0x7fee4c004800 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee60a96640 1 --2- 172.21.15.155:0/507017311 >> v2:172.21.15.191:3300/0 conn(0x7fee5c144270 0x7fee5c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5bfff640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c8e70 0x7fee5c074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee61297640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee60a96640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee5bfff640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee61297640 1 -- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee4c004800 msgr2=0x7fee4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee61297640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee4c004800 0x7fee4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee61297640 1 -- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee4c0039b0 msgr2=0x7fee4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee61297640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee4c0039b0 0x7fee4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.209+0000 7fee61297640 1 -- 172.21.15.155:0/507017311 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c003520 con 0x7fee4c0051c0 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee61297640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee5400a920 tx=0x7fee4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7441bf703ff9a784 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5400a4c0 con 0x7fee4c0051c0 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee5402f070 con 0x7fee4c0051c0 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee5b7fe640 1 -- 172.21.15.155:0/507017311 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5402bd00 con 0x7fee4c0051c0 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee62cfa640 1 -- 172.21.15.155:0/507017311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee4c0051c0 msgr2=0x7fee4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee62cfa640 1 --2- 172.21.15.155:0/507017311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee4c0051c0 0x7fee4c00b9c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fee5400a920 tx=0x7fee4c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee61297640 1 -- 172.21.15.155:0/507017311 reap_dead start 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee62cfa640 1 -- 172.21.15.155:0/507017311 shutdown_connections 2024-04-25T13:16:46.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee62cfa640 1 -- 172.21.15.155:0/507017311 >> 172.21.15.155:0/507017311 conn(0x7fee5c06b920 msgr2=0x7fee5c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee62cfa640 1 -- 172.21.15.155:0/507017311 shutdown_connections 2024-04-25T13:16:46.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.210+0000 7fee62cfa640 1 -- 172.21.15.155:0/507017311 wait complete. 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.211+0000 7fee62cfa640 1 Processor -- start 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 -- start start 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c6210 0x7fee5c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 0x7fee5c157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee5c155910 0x7fee5c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c15b8e0 con 0x7fee5c0ccc30 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c15b600 con 0x7fee5c155910 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee62cfa640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c0ce360 con 0x7fee5c0c6210 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.212+0000 7fee5bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 0x7fee5c157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 0x7fee5c157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48214/0 (socket says 172.21.15.155:48214) 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 -- 172.21.15.155:0/2368636736 learned_addr learned my addr 172.21.15.155:0/2368636736 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee61297640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee5c155910 0x7fee5c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee60a96640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c6210 0x7fee5c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 -- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c6210 msgr2=0x7fee5c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c6210 0x7fee5c0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 -- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee5c155910 msgr2=0x7fee5c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee5c155910 0x7fee5c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 -- 172.21.15.155:0/2368636736 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c0c6b30 con 0x7fee5c0ccc30 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee5bfff640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 0x7fee5c157230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee48011800 tx=0x7fee48011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4800f9c0 con 0x7fee5c0ccc30 2024-04-25T13:16:46.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4800fb60 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c0cd190 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48015460 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.213+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c156470 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.214+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5c068e40 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.215+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee48015600 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.215+0000 7fee597fa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fee4006c8f0 0x7fee4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.215+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fee4808c850 con 0x7fee5c0ccc30 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.215+0000 7fee60a96640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fee4006c8f0 0x7fee4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.216+0000 7fee60a96640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fee4006c8f0 0x7fee4006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee500093d0 tx=0x7fee50009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.220+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fee48019030 con 0x7fee5c0ccc30 2024-04-25T13:16:46.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.395+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee5c0c77e0 con 0x7fee5c0ccc30 2024-04-25T13:16:46.396 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.396+0000 7fee597fa640 1 -- 172.21.15.155:0/2368636736 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7fee4805a260 con 0x7fee5c0ccc30 2024-04-25T13:16:46.397 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:46.397 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.398+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fee4006c8f0 msgr2=0x7fee4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.398+0000 7fee62cfa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fee4006c8f0 0x7fee4006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee500093d0 tx=0x7fee50009190 comp rx=0 tx=0).stop 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.398+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 msgr2=0x7fee5c157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.398+0000 7fee62cfa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 0x7fee5c157230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fee48011800 tx=0x7fee48011cc0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 shutdown_connections 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fee5c155910 0x7fee5c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee5c0ccc30 0x7fee5c157230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.399 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fee4006c8f0 0x7fee4006edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 --2- 172.21.15.155:0/2368636736 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fee5c0c6210 0x7fee5c0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 >> 172.21.15.155:0/2368636736 conn(0x7fee5c06b920 msgr2=0x7fee5c141140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 shutdown_connections 2024-04-25T13:16:46.400 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.399+0000 7fee62cfa640 1 -- 172.21.15.155:0/2368636736 wait complete. 2024-04-25T13:16:46.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:46.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.509+0000 7faa7675d640 1 Processor -- start 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.509+0000 7faa7675d640 1 -- start start 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa7675d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faa70151e70 0x7faa700cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa7675d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faa700c88f0 0x7faa700cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa7675d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa700ca610 0x7faa70072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa7675d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faa70157c30 con 0x7faa70151e70 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa7675d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faa70157e60 con 0x7faa700c88f0 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa7675d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faa70158100 con 0x7faa700ca610 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa6ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faa70151e70 0x7faa700cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa6ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faa70151e70 0x7faa700cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48226/0 (socket says 172.21.15.155:48226) 2024-04-25T13:16:46.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.510+0000 7faa6ffff640 1 -- 172.21.15.155:0/2114200993 learned_addr learned my addr 172.21.15.155:0/2114200993 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6f7fe640 1 --2- 172.21.15.155:0/2114200993 >> v2:172.21.15.191:3300/0 conn(0x7faa700c88f0 0x7faa700cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa74cfa640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa700ca610 0x7faa70072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6ffff640 1 -- 172.21.15.155:0/2114200993 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa700ca610 msgr2=0x7faa70072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6ffff640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa700ca610 0x7faa70072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6ffff640 1 -- 172.21.15.155:0/2114200993 >> v2:172.21.15.191:3300/0 conn(0x7faa700c88f0 msgr2=0x7faa700cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6ffff640 1 --2- 172.21.15.155:0/2114200993 >> v2:172.21.15.191:3300/0 conn(0x7faa700c88f0 0x7faa700cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6ffff640 1 -- 172.21.15.155:0/2114200993 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa701583a0 con 0x7faa70151e70 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6f7fe640 1 --2- 172.21.15.155:0/2114200993 >> v2:172.21.15.191:3300/0 conn(0x7faa700c88f0 0x7faa700cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa74cfa640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa700ca610 0x7faa70072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.511+0000 7faa6ffff640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa70151e70 0x7faa700cd890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa700c7c20 tx=0x7faa6402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e017a8e1e245edae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa6effd640 1 -- 172.21.15.155:0/2114200993 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64032790 con 0x7faa70151e70 2024-04-25T13:16:46.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa6effd640 1 -- 172.21.15.155:0/2114200993 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64038070 con 0x7faa70151e70 2024-04-25T13:16:46.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa6effd640 1 -- 172.21.15.155:0/2114200993 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64032b50 con 0x7faa70151e70 2024-04-25T13:16:46.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 -- 172.21.15.155:0/2114200993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa70151e70 msgr2=0x7faa700cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa70151e70 0x7faa700cd890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faa700c7c20 tx=0x7faa6402c890 comp rx=0 tx=0).stop 2024-04-25T13:16:46.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 -- 172.21.15.155:0/2114200993 shutdown_connections 2024-04-25T13:16:46.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa700ca610 0x7faa70072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 --2- 172.21.15.155:0/2114200993 >> v2:172.21.15.191:3300/0 conn(0x7faa700c88f0 0x7faa700cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 --2- 172.21.15.155:0/2114200993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa70151e70 0x7faa700cd890 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 -- 172.21.15.155:0/2114200993 >> 172.21.15.155:0/2114200993 conn(0x7faa7006b920 msgr2=0x7faa7006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 -- 172.21.15.155:0/2114200993 shutdown_connections 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.512+0000 7faa7675d640 1 -- 172.21.15.155:0/2114200993 wait complete. 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.513+0000 7faa7675d640 1 Processor -- start 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 -- start start 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa700c88f0 0x7faa701595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 0x7faa70159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa70151e70 0x7faa701547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa70152250 con 0x7faa700ca610 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faa70158920 con 0x7faa700c88f0 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa7675d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faa701523d0 con 0x7faa70151e70 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 0x7faa70159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 0x7faa70159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48234/0 (socket says 172.21.15.155:48234) 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.514+0000 7faa6f7fe640 1 -- 172.21.15.155:0/502528833 learned_addr learned my addr 172.21.15.155:0/502528833 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6ffff640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa700c88f0 0x7faa701595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa74cfa640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa70151e70 0x7faa701547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6f7fe640 1 -- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa70151e70 msgr2=0x7faa701547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6f7fe640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa70151e70 0x7faa701547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6f7fe640 1 -- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa700c88f0 msgr2=0x7faa701595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6f7fe640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa700c88f0 0x7faa701595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6f7fe640 1 -- 172.21.15.155:0/502528833 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa70158df0 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6f7fe640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 0x7faa70159b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c7c0 tx=0x7faa6000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60015070 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa60007a30 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa700c67c0 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60007e00 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.515+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa700c6d80 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.516+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa70068e40 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.517+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa60018070 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.517+0000 7faa6cff9640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faa5c06c8f0 0x7faa5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.517+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faa6008bd30 con 0x7faa700ca610 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.517+0000 7faa6ffff640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faa5c06c8f0 0x7faa5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.518+0000 7faa6ffff640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faa5c06c8f0 0x7faa5c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa64037000 tx=0x7faa6403e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.521+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa60059750 con 0x7faa700ca610 2024-04-25T13:16:46.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.706+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa700c4510 con 0x7faa700ca610 2024-04-25T13:16:46.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.707+0000 7faa6cff9640 1 -- 172.21.15.155:0/502528833 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7faa6005da50 con 0x7faa700ca610 2024-04-25T13:16:46.707 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:46.708 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:46.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faa5c06c8f0 msgr2=0x7faa5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faa5c06c8f0 0x7faa5c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa64037000 tx=0x7faa6403e040 comp rx=0 tx=0).stop 2024-04-25T13:16:46.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 msgr2=0x7faa70159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 0x7faa70159b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa6000c7c0 tx=0x7faa6000cc80 comp rx=0 tx=0).stop 2024-04-25T13:16:46.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 shutdown_connections 2024-04-25T13:16:46.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faa5c06c8f0 0x7faa5c06edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faa70151e70 0x7faa701547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa700ca610 0x7faa70159b10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 --2- 172.21.15.155:0/502528833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa700c88f0 0x7faa701595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 >> 172.21.15.155:0/502528833 conn(0x7faa7006b920 msgr2=0x7faa700c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 shutdown_connections 2024-04-25T13:16:46.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.710+0000 7faa7675d640 1 -- 172.21.15.155:0/502528833 wait complete. 2024-04-25T13:16:46.721 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:16:46.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.824+0000 7f7d4e12d640 1 Processor -- start 2024-04-25T13:16:46.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.824+0000 7f7d4e12d640 1 -- start start 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d4e12d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7d48158e80 0x7f7d48164810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d4e12d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d480c9da0 con 0x7f7d48153140 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d4e12d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d48073ad0 con 0x7f7d480c9860 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d4e12d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7d4815c980 con 0x7f7d48158e80 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d47fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7d48158e80 0x7f7d48164810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d47fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7d48158e80 0x7f7d48164810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48246/0 (socket says 172.21.15.155:48246) 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d47fff640 1 -- 172.21.15.155:0/4015039012 learned_addr learned my addr 172.21.15.155:0/4015039012 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:46.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d47fff640 1 -- 172.21.15.155:0/4015039012 >> v1:172.21.15.191:6789/0 conn(0x7f7d480c9860 legacy=0x7f7d480ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d47fff640 1 -- 172.21.15.155:0/4015039012 >> v1:172.21.15.155:6789/0 conn(0x7f7d48153140 legacy=0x7f7d4815ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.825+0000 7f7d47fff640 1 -- 172.21.15.155:0/4015039012 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d48073db0 con 0x7f7d48158e80 2024-04-25T13:16:46.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.826+0000 7f7d47fff640 1 --2- 172.21.15.155:0/4015039012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d48164810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009e50 tx=0x7f7d4002a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f9ff316fdb7bb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.826+0000 7f7d46ffd640 1 -- 172.21.15.155:0/4015039012 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40037070 con 0x7f7d48158e80 2024-04-25T13:16:46.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.826+0000 7f7d46ffd640 1 -- 172.21.15.155:0/4015039012 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d40032630 con 0x7f7d48158e80 2024-04-25T13:16:46.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.826+0000 7f7d46ffd640 1 -- 172.21.15.155:0/4015039012 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4002e050 con 0x7f7d48158e80 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4015039012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 msgr2=0x7f7d48164810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4015039012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d48164810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009e50 tx=0x7f7d4002a840 comp rx=0 tx=0).stop 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4015039012 shutdown_connections 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4015039012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d48164810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4015039012 >> 172.21.15.155:0/4015039012 conn(0x7f7d48068570 msgr2=0x7f7d48070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4015039012 shutdown_connections 2024-04-25T13:16:46.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.827+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4015039012 wait complete. 2024-04-25T13:16:46.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.828+0000 7f7d4e12d640 1 Processor -- start 2024-04-25T13:16:46.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 -- start start 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d480c9860 0x7f7d48157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d48153140 0x7f7d481f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d481f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48073550 con 0x7f7d48158e80 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7d48153520 con 0x7f7d48153140 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d4e12d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7d480ced50 con 0x7f7d480c9860 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d481f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d47fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d481f1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48256/0 (socket says 172.21.15.155:48256) 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.829+0000 7f7d47fff640 1 -- 172.21.15.155:0/4195770842 learned_addr learned my addr 172.21.15.155:0/4195770842 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d3effd640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d48153140 0x7f7d481f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d477fe640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d480c9860 0x7f7d48157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d47fff640 1 -- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d480c9860 msgr2=0x7f7d48157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d47fff640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d480c9860 0x7f7d48157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d47fff640 1 -- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d48153140 msgr2=0x7f7d481f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d47fff640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d48153140 0x7f7d481f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d47fff640 1 -- 172.21.15.155:0/4195770842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d481f4400 con 0x7f7d48158e80 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d47fff640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d481f1430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009e50 tx=0x7f7d40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40037050 con 0x7f7d48158e80 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d40043070 con 0x7f7d48158e80 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d481f46e0 con 0x7f7d48158e80 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40009510 con 0x7f7d48158e80 2024-04-25T13:16:46.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.830+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d481f4ca0 con 0x7f7d48158e80 2024-04-25T13:16:46.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.831+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d48068f50 con 0x7f7d48158e80 2024-04-25T13:16:46.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.832+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d40007b70 con 0x7f7d48158e80 2024-04-25T13:16:46.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.832+0000 7f7d44ff9640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7d2806c920 0x7f7d2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:46.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.832+0000 7f7d477fe640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7d2806c920 0x7f7d2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:46.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.832+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7d400aca10 con 0x7f7d48158e80 2024-04-25T13:16:46.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.833+0000 7f7d477fe640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7d2806c920 0x7f7d2806ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000f60 tx=0x7f7d38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:46.836 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:46.837+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7d4007ac20 con 0x7f7d48158e80 2024-04-25T13:16:47.059 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.060+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7d48075cb0 con 0x7f7d48158e80 2024-04-25T13:16:47.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.728+0000 7f7d44ff9640 1 -- 172.21.15.155:0/4195770842 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f7d4007a520 con 0x7f7d48158e80 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7d2806c920 msgr2=0x7f7d2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7d2806c920 0x7f7d2806ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d38000f60 tx=0x7f7d38009040 comp rx=0 tx=0).stop 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 msgr2=0x7f7d481f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d481f1430 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009e50 tx=0x7f7d40004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 shutdown_connections 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d48158e80 0x7f7d481f1430 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d48153140 0x7f7d481f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7d2806c920 0x7f7d2806ede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 --2- 172.21.15.155:0/4195770842 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7d480c9860 0x7f7d48157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 >> 172.21.15.155:0/4195770842 conn(0x7f7d48068570 msgr2=0x7f7d480ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:47.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 shutdown_connections 2024-04-25T13:16:47.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.731+0000 7f7d4e12d640 1 -- 172.21.15.155:0/4195770842 wait complete. 2024-04-25T13:16:47.742 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-25T13:16:47.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-25T13:16:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.842+0000 7f7b8d9f7640 1 Processor -- start 2024-04-25T13:16:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.842+0000 7f7b8d9f7640 1 -- start start 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b8d9f7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 0x7f7b88158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b8d9f7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7b88159370 0x7f7b880733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b8d9f7640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b880c4850 con 0x7f7b88153230 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b8d9f7640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f7b880c6590 con 0x7f7b88159370 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b8d9f7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7b880c4290 con 0x7f7b880c9880 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b86ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f7b88153230 0x7f7b880c3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48528/0 (socket says 172.21.15.155:48528) 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b86ffd640 1 -- 172.21.15.155:0/1860721023 learned_addr learned my addr 172.21.15.155:0/1860721023 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b877fe640 1 --2- 172.21.15.155:0/1860721023 >> v2:172.21.15.191:3300/0 conn(0x7f7b88159370 0x7f7b880733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b867fc640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 0x7f7b88158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897569486 0 0) 0x7f7b880c4850 con 0x7f7b88153230 2024-04-25T13:16:47.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.843+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b70003520 con 0x7f7b88153230 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3951269826 0 0) 0x7f7b70003520 con 0x7f7b88153230 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 msgr2=0x7f7b88158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 0x7f7b88158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 >> v2:172.21.15.191:3300/0 conn(0x7f7b88159370 msgr2=0x7f7b880733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 --2- 172.21.15.155:0/1860721023 >> v2:172.21.15.191:3300/0 conn(0x7f7b88159370 0x7f7b880733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b880c4570 con 0x7f7b88153230 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f7b780019f0 con 0x7f7b88153230 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 >> v1:172.21.15.155:6789/0 conn(0x7f7b88153230 legacy=0x7f7b880c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b700039b0 0x7f7b70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 0x7f7b70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b70004d40 0x7f7b700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880c6590 con 0x7f7b70004d40 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880c4290 con 0x7f7b700039b0 2024-04-25T13:16:47.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7000b9c0 con 0x7f7b880c9880 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b877fe640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b70004d40 0x7f7b700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b867fc640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 0x7f7b70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b86ffd640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b700039b0 0x7f7b70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b877fe640 1 -- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 msgr2=0x7f7b70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b877fe640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c9880 0x7f7b70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b877fe640 1 -- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b700039b0 msgr2=0x7f7b70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b877fe640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b700039b0 0x7f7b70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.844+0000 7f7b877fe640 1 -- 172.21.15.155:0/1860721023 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b70003520 con 0x7f7b70004d40 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.845+0000 7f7b877fe640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b70004d40 0x7f7b700051c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009a90 tx=0x7f7b70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe29c16ad624c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.845+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80036070 con 0x7f7b70004d40 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.845+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80031400 con 0x7f7b70004d40 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.845+0000 7f7b85ffb640 1 -- 172.21.15.155:0/1860721023 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80009690 con 0x7f7b70004d40 2024-04-25T13:16:47.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/1860721023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b70004d40 msgr2=0x7f7b700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/1860721023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b70004d40 0x7f7b700051c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009a90 tx=0x7f7b70005830 comp rx=0 tx=0).stop 2024-04-25T13:16:47.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b877fe640 1 -- 172.21.15.155:0/1860721023 reap_dead start 2024-04-25T13:16:47.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/1860721023 shutdown_connections 2024-04-25T13:16:47.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/1860721023 >> 172.21.15.155:0/1860721023 conn(0x7f7b8806d660 msgr2=0x7f7b88074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:47.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/1860721023 shutdown_connections 2024-04-25T13:16:47.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.846+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/1860721023 wait complete. 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.847+0000 7f7b8d9f7640 1 Processor -- start 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.847+0000 7f7b8d9f7640 1 -- start start 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b880c75b0 0x7f7b88137960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c7990 0x7f7b881eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 0x7f7b88136ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880c6a20 con 0x7f7b8813a490 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7b880c6220 con 0x7f7b880c75b0 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7b880c9ca0 con 0x7f7b880c7990 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 0x7f7b88136ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 0x7f7b88136ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48272/0 (socket says 172.21.15.155:48272) 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 -- 172.21.15.155:0/272716076 learned_addr learned my addr 172.21.15.155:0/272716076 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b867fc640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c7990 0x7f7b881eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b86ffd640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b880c75b0 0x7f7b88137960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 -- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c7990 msgr2=0x7f7b881eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c7990 0x7f7b881eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 -- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b880c75b0 msgr2=0x7f7b88137960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b880c75b0 0x7f7b88137960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 -- 172.21.15.155:0/272716076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b881395f0 con 0x7f7b8813a490 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b877fe640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 0x7f7b88136ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b80034040 tx=0x7f7b80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80040070 con 0x7f7b8813a490 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80037040 con 0x7f7b8813a490 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80036070 con 0x7f7b8813a490 2024-04-25T13:16:47.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.848+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b881398d0 con 0x7f7b8813a490 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.849+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b88139e90 con 0x7f7b8813a490 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.849+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b8813a090 con 0x7f7b8813a490 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.850+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b80043070 con 0x7f7b8813a490 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.850+0000 7f7b6ffff640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b7406c920 0x7f7b7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.850+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7b800ab440 con 0x7f7b8813a490 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.850+0000 7f7b86ffd640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b7406c920 0x7f7b7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.851+0000 7f7b86ffd640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b7406c920 0x7f7b7406ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b78004bc0 tx=0x7f7b78006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:47.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:47.855+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b80078e50 con 0x7f7b8813a490 2024-04-25T13:16:48.064 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.064+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f7b88068f50 con 0x7f7b8813a490 2024-04-25T13:16:48.737 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.737+0000 7f7b6ffff640 1 -- 172.21.15.155:0/272716076 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f7b8007d150 con 0x7f7b8813a490 2024-04-25T13:16:48.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b7406c920 msgr2=0x7f7b7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b7406c920 0x7f7b7406ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b78004bc0 tx=0x7f7b78006040 comp rx=0 tx=0).stop 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 msgr2=0x7f7b88136ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 0x7f7b88136ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7b80034040 tx=0x7f7b80004730 comp rx=0 tx=0).stop 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 shutdown_connections 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b8813a490 0x7f7b88136ba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7b7406c920 0x7f7b7406ede0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7b880c7990 0x7f7b881eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 --2- 172.21.15.155:0/272716076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b880c75b0 0x7f7b88137960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 >> 172.21.15.155:0/272716076 conn(0x7f7b8806d660 msgr2=0x7f7b880c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 shutdown_connections 2024-04-25T13:16:48.741 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.740+0000 7f7b8d9f7640 1 -- 172.21.15.155:0/272716076 wait complete. 2024-04-25T13:16:48.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T13:16:48.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.860+0000 7fde899cd640 1 Processor -- start 2024-04-25T13:16:48.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.860+0000 7fde899cd640 1 -- start start 2024-04-25T13:16:48.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde899cd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fde840c9880 0x7fde84158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde899cd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde84159370 0x7fde840733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde899cd640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde840c4850 con 0x7fde84153230 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde899cd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fde840c6590 con 0x7fde84159370 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde899cd640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fde840c4290 con 0x7fde840c9880 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde84159370 0x7fde840733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde84159370 0x7fde840733e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48288/0 (socket says 172.21.15.155:48288) 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 -- 172.21.15.155:0/3943924227 learned_addr learned my addr 172.21.15.155:0/3943924227 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde827fc640 1 --2- 172.21.15.155:0/3943924227 >> v2:172.21.15.191:3300/0 conn(0x7fde840c9880 0x7fde84158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 -- 172.21.15.155:0/3943924227 >> v2:172.21.15.191:3300/0 conn(0x7fde840c9880 msgr2=0x7fde84158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 --2- 172.21.15.155:0/3943924227 >> v2:172.21.15.191:3300/0 conn(0x7fde840c9880 0x7fde84158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 -- 172.21.15.155:0/3943924227 >> v1:172.21.15.191:6789/0 conn(0x7fde84153230 legacy=0x7fde840c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.861+0000 7fde837fe640 1 -- 172.21.15.155:0/3943924227 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde840c4570 con 0x7fde84159370 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.862+0000 7fde837fe640 1 --2- 172.21.15.155:0/3943924227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde840733e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde840c5450 tx=0x7fde7c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f4586c19e32410 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.862+0000 7fde81ffb640 1 -- 172.21.15.155:0/3943924227 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c036070 con 0x7fde84159370 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.862+0000 7fde81ffb640 1 -- 172.21.15.155:0/3943924227 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c031600 con 0x7fde84159370 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.862+0000 7fde81ffb640 1 -- 172.21.15.155:0/3943924227 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0319f0 con 0x7fde84159370 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 -- 172.21.15.155:0/3943924227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 msgr2=0x7fde840733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 --2- 172.21.15.155:0/3943924227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde840733e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde840c5450 tx=0x7fde7c02a7c0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 -- 172.21.15.155:0/3943924227 shutdown_connections 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 --2- 172.21.15.155:0/3943924227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde840733e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 --2- 172.21.15.155:0/3943924227 >> v2:172.21.15.191:3300/0 conn(0x7fde840c9880 0x7fde84158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 -- 172.21.15.155:0/3943924227 >> 172.21.15.155:0/3943924227 conn(0x7fde8406d660 msgr2=0x7fde84074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:48.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 -- 172.21.15.155:0/3943924227 shutdown_connections 2024-04-25T13:16:48.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.863+0000 7fde899cd640 1 -- 172.21.15.155:0/3943924227 wait complete. 2024-04-25T13:16:48.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.864+0000 7fde899cd640 1 Processor -- start 2024-04-25T13:16:48.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.864+0000 7fde899cd640 1 -- start start 2024-04-25T13:16:48.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde899cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde840c9880 0x7fde841f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde899cd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde84153230 0x7fde84154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde899cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde8415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde899cd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde840c6a20 con 0x7fde84159370 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde899cd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fde840c6220 con 0x7fde840c9880 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde899cd640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fde840c9cd0 con 0x7fde84153230 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde8415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde8415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48304/0 (socket says 172.21.15.155:48304) 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 -- 172.21.15.155:0/1549410382 learned_addr learned my addr 172.21.15.155:0/1549410382 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde82ffd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde840c9880 0x7fde841f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde827fc640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde84153230 0x7fde84154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 -- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde84153230 msgr2=0x7fde84154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde84153230 0x7fde84154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 -- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde840c9880 msgr2=0x7fde841f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde840c9880 0x7fde841f1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 -- 172.21.15.155:0/1549410382 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde84155d60 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde837fe640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde8415b270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde7c02a800 tx=0x7fde7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.865+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c036050 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.866+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c042070 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.866+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c009510 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.866+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde84156040 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.866+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8413c2e0 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.867+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde84068f50 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.867+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde7c004470 con 0x7fde84159370 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.868+0000 7fde6bfff640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fde7006c8f0 0x7fde7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.868+0000 7fde82ffd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fde7006c8f0 0x7fde7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:48.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.868+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde7c0acb30 con 0x7fde84159370 2024-04-25T13:16:48.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.868+0000 7fde82ffd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fde7006c8f0 0x7fde7006edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde74001780 tx=0x7fde74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:48.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:48.872+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde7c07a5d0 con 0x7fde84159370 2024-04-25T13:16:49.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.084+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fde84074ec0 con 0x7fde84159370 2024-04-25T13:16:49.748 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.748+0000 7fde6bfff640 1 -- 172.21.15.155:0/1549410382 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fde7c07e8d0 con 0x7fde84159370 2024-04-25T13:16:49.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fde7006c8f0 msgr2=0x7fde7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fde7006c8f0 0x7fde7006edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fde74001780 tx=0x7fde74009040 comp rx=0 tx=0).stop 2024-04-25T13:16:49.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 msgr2=0x7fde8415b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde8415b270 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde7c02a800 tx=0x7fde7c004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:49.751 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 shutdown_connections 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde84159370 0x7fde8415b270 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fde7006c8f0 0x7fde7006edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fde84153230 0x7fde84154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 --2- 172.21.15.155:0/1549410382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fde840c9880 0x7fde841f1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 >> 172.21.15.155:0/1549410382 conn(0x7fde8406d660 msgr2=0x7fde84158800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 shutdown_connections 2024-04-25T13:16:49.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.750+0000 7fde899cd640 1 -- 172.21.15.155:0/1549410382 wait complete. 2024-04-25T13:16:49.762 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T13:16:49.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.866+0000 7fb4eb1e2640 1 Processor -- start 2024-04-25T13:16:49.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.866+0000 7fb4eb1e2640 1 -- start start 2024-04-25T13:16:49.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4eb1e2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb4e4074360 0x7fb4e4073d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4eb1e2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 0x7fb4e415ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4eb1e2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e415f4b0 con 0x7fb4e4154fe0 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4eb1e2640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e415e6b0 con 0x7fb4e4074360 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4eb1e2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e415e950 con 0x7fb4e41553c0 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4e8f7e640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fb4e4154fe0 0x7fb4e40ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48544/0 (socket says 172.21.15.155:48544) 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4e8f7e640 1 -- 172.21.15.155:0/3183748517 learned_addr learned my addr 172.21.15.155:0/3183748517 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877679670 0 0) 0x7fb4e415f4b0 con 0x7fb4e4154fe0 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4e3fff640 1 --2- 172.21.15.155:0/3183748517 >> v2:172.21.15.191:3300/0 conn(0x7fb4e4074360 0x7fb4e4073d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4e977f640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 0x7fb4e415ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.867+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4d4003520 con 0x7fb4e4154fe0 2024-04-25T13:16:49.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2558053116 0 0) 0x7fb4d4003520 con 0x7fb4e4154fe0 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 msgr2=0x7fb4e415ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 0x7fb4e415ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 >> v2:172.21.15.191:3300/0 conn(0x7fb4e4074360 msgr2=0x7fb4e4073d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 --2- 172.21.15.155:0/3183748517 >> v2:172.21.15.191:3300/0 conn(0x7fb4e4074360 0x7fb4e4073d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e415ec10 con 0x7fb4e4154fe0 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fb4d8001670 con 0x7fb4e4154fe0 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 >> v1:172.21.15.155:6789/0 conn(0x7fb4e4154fe0 legacy=0x7fb4e40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4d40039b0 0x7fb4d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 0x7fb4d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d4004d40 0x7fb4d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415e6b0 con 0x7fb4d40039b0 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415e950 con 0x7fb4d4004d40 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d400b9c0 con 0x7fb4e41553c0 2024-04-25T13:16:49.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4d40039b0 0x7fb4d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e977f640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d4004d40 0x7fb4d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e3fff640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 0x7fb4d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e8f7e640 1 -- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 msgr2=0x7fb4d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4e41553c0 0x7fb4d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e8f7e640 1 -- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d4004d40 msgr2=0x7fb4d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4d4004d40 0x7fb4d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.868+0000 7fb4e8f7e640 1 -- 172.21.15.155:0/3183748517 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d4003520 con 0x7fb4d40039b0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4d40039b0 0x7fb4d4003dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800c240 tx=0x7fb4d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b920033ae4f08f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d802e070 con 0x7fb4d40039b0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d8005af0 con 0x7fb4d40039b0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4e37fe640 1 -- 172.21.15.155:0/3183748517 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8007d30 con 0x7fb4d40039b0 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3183748517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4d40039b0 msgr2=0x7fb4d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3183748517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4d40039b0 0x7fb4d4003dd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800c240 tx=0x7fb4d4005830 comp rx=0 tx=0).stop 2024-04-25T13:16:49.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4e977f640 1 -- 172.21.15.155:0/3183748517 reap_dead start 2024-04-25T13:16:49.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.869+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3183748517 shutdown_connections 2024-04-25T13:16:49.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.870+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3183748517 >> 172.21.15.155:0/3183748517 conn(0x7fb4e4068570 msgr2=0x7fb4e4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:49.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.870+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3183748517 shutdown_connections 2024-04-25T13:16:49.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.870+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3183748517 wait complete. 2024-04-25T13:16:49.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.871+0000 7fb4eb1e2640 1 Processor -- start 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.871+0000 7fb4eb1e2640 1 -- start start 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.871+0000 7fb4eb1e2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4d40039b0 0x7fb4e414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.871+0000 7fb4eb1e2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4e40c8e80 0x7fb4e41e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.871+0000 7fb4eb1e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 0x7fb4e41e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4eb1e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415c540 con 0x7fb4e414a5c0 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4eb1e2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e415f1d0 con 0x7fb4e40c8e80 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4eb1e2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e406c3c0 con 0x7fb4d40039b0 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 0x7fb4e41e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 0x7fb4e41e6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48324/0 (socket says 172.21.15.155:48324) 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 -- 172.21.15.155:0/3669895498 learned_addr learned my addr 172.21.15.155:0/3669895498 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e3fff640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4e40c8e80 0x7fb4e41e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4d40039b0 0x7fb4e414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 -- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4d40039b0 msgr2=0x7fb4e414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4d40039b0 0x7fb4e414fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 -- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4e40c8e80 msgr2=0x7fb4e41e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4e40c8e80 0x7fb4e41e66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 -- 172.21.15.155:0/3669895498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e41f5c90 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e977f640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 0x7fb4e41e6bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4075a20 tx=0x7fb4dc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00fd10 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4dc01d070 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e41f19c0 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc015670 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.872+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e41f1c60 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.873+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e406c750 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.874+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4dc015810 con 0x7fb4e414a5c0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.874+0000 7fb4e17fa640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb4c806c920 0x7fb4c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.874+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb4c806c920 0x7fb4c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:49.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.874+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb4dc08c6d0 con 0x7fb4e414a5c0 2024-04-25T13:16:49.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.875+0000 7fb4e8f7e640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb4c806c920 0x7fb4c806ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8033000 tx=0x7fb4d8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:49.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:49.879+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb4e406c750 con 0x7fb4e414a5c0 2024-04-25T13:16:50.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.088+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb4e4068f50 con 0x7fb4e414a5c0 2024-04-25T13:16:50.749 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.749+0000 7fb4e17fa640 1 -- 172.21.15.155:0/3669895498 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7fb4dc010040 con 0x7fb4e414a5c0 2024-04-25T13:16:50.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb4c806c920 msgr2=0x7fb4c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb4c806c920 0x7fb4c806ede0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8033000 tx=0x7fb4d8009030 comp rx=0 tx=0).stop 2024-04-25T13:16:50.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 msgr2=0x7fb4e41e6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 0x7fb4e41e6bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4075a20 tx=0x7fb4dc00f1b0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 shutdown_connections 2024-04-25T13:16:50.752 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4e414a5c0 0x7fb4e41e6bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4e40c8e80 0x7fb4e41e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb4c806c920 0x7fb4c806ede0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 --2- 172.21.15.155:0/3669895498 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb4d40039b0 0x7fb4e414fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 >> 172.21.15.155:0/3669895498 conn(0x7fb4e4068570 msgr2=0x7fb4e414d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:50.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 shutdown_connections 2024-04-25T13:16:50.753 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.752+0000 7fb4eb1e2640 1 -- 172.21.15.155:0/3669895498 wait complete. 2024-04-25T13:16:50.765 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T13:16:50.765 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:16:50.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.867+0000 7f742fcd0640 1 Processor -- start 2024-04-25T13:16:50.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.867+0000 7f742fcd0640 1 -- start start 2024-04-25T13:16:50.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742fcd0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f742806bf70 0x7f742815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742fcd0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742fcd0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742815bef0 con 0x7f742806bb90 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742fcd0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f742815f510 con 0x7f742806bf70 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742fcd0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f742815b650 con 0x7f74280c99f0 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f742806bf70 0x7f742815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f742806bf70 0x7f742815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48326/0 (socket says 172.21.15.155:48326) 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 -- 172.21.15.155:0/3019591399 learned_addr learned my addr 172.21.15.155:0/3019591399 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742e26d640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 -- 172.21.15.155:0/3019591399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 msgr2=0x7f74280c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 -- 172.21.15.155:0/3019591399 >> v1:172.21.15.155:6789/0 conn(0x7f742806bb90 legacy=0x7f742815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742d26b640 1 -- 172.21.15.155:0/3019591399 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742815b930 con 0x7f742806bf70 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.868+0000 7f742e26d640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742d26b640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f742815af70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7418009870 tx=0x7f741802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdeaa4fc787f34f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:50.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742ca6a640 1 -- 172.21.15.155:0/3019591399 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418037070 con 0x7f742806bf70 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742ca6a640 1 -- 172.21.15.155:0/3019591399 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741802ae50 con 0x7f742806bf70 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742ca6a640 1 -- 172.21.15.155:0/3019591399 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418032860 con 0x7f742806bf70 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 -- 172.21.15.155:0/3019591399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 msgr2=0x7f742815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f742815af70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7418009870 tx=0x7f741802a300 comp rx=0 tx=0).stop 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 -- 172.21.15.155:0/3019591399 shutdown_connections 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3019591399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f742815af70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 -- 172.21.15.155:0/3019591399 >> 172.21.15.155:0/3019591399 conn(0x7f7428074d50 msgr2=0x7f7428075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 -- 172.21.15.155:0/3019591399 shutdown_connections 2024-04-25T13:16:50.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.869+0000 7f742fcd0640 1 -- 172.21.15.155:0/3019591399 wait complete. 2024-04-25T13:16:50.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 Processor -- start 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 -- start start 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f742806bb90 0x7f74281f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f74280cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f742815e8e0 con 0x7f742806bf70 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f742815e600 con 0x7f742806bb90 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742fcd0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7428074560 con 0x7f74280c99f0 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742d26b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f74280cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742d26b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f74280cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48334/0 (socket says 172.21.15.155:48334) 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.871+0000 7f742d26b640 1 -- 172.21.15.155:0/3970828217 learned_addr learned my addr 172.21.15.155:0/3970828217 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742e26d640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742da6c640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f742806bb90 0x7f74281f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.875 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742d26b640 1 -- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 msgr2=0x7f74280cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742d26b640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742d26b640 1 -- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f742806bb90 msgr2=0x7f74281f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742d26b640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f742806bb90 0x7f74281f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742d26b640 1 -- 172.21.15.155:0/3970828217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74281f55e0 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742e26d640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742d26b640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f74280cec10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f741802a340 tx=0x7f74180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418041020 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741803c890 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7428158840 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418037040 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.872+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742814db90 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.873+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7428153b60 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.873+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7418044020 con 0x7f742806bf70 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.874+0000 7f741e7fc640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f740c06c8f0 0x7f740c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:50.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.874+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f74180ac830 con 0x7f742806bf70 2024-04-25T13:16:50.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.874+0000 7f742da6c640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f740c06c8f0 0x7f740c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:50.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.874+0000 7f742da6c640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f740c06c8f0 0x7f740c06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74240015a0 tx=0x7f7424009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:50.878 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:50.878+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7428153b60 con 0x7f742806bf70 2024-04-25T13:16:51.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.088+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7428068e40 con 0x7f742806bf70 2024-04-25T13:16:51.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.088+0000 7f741e7fc640 1 -- 172.21.15.155:0/3970828217 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6859 (secure 0 0 0) 0x7f741804b030 con 0x7f742806bf70 2024-04-25T13:16:51.088 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:51.089 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:16:50.089997+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4305,"mds_1":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-25T13:16:51.089 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 11 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f740c06c8f0 msgr2=0x7f740c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f740c06c8f0 0x7f740c06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74240015a0 tx=0x7f7424009040 comp rx=0 tx=0).stop 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 msgr2=0x7f74280cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f74280cec10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f741802a340 tx=0x7f74180046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 shutdown_connections 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f740c06c8f0 0x7f740c06edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f74280c99f0 0x7f74280cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f742806bf70 0x7f74280cec10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 --2- 172.21.15.155:0/3970828217 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f742806bb90 0x7f74281f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 >> 172.21.15.155:0/3970828217 conn(0x7f7428074d50 msgr2=0x7f7428154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 shutdown_connections 2024-04-25T13:16:51.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.090+0000 7f742fcd0640 1 -- 172.21.15.155:0/3970828217 wait complete. 2024-04-25T13:16:51.101 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:51.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.198+0000 7f7e52cb9640 1 Processor -- start 2024-04-25T13:16:51.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.198+0000 7f7e52cb9640 1 -- start start 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e52cb9640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e52cb9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e4c0b3c00 0x7f7e4c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e52cb9640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f7e4c0b5450 0x7f7e4c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e52cb9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4c0b4a80 con 0x7f7e4c0b3c00 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e52cb9640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f7e4c1558c0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e52cb9640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c15f630 con 0x7f7e4c1554e0 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e4c0b3c00 0x7f7e4c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7e4c0b3c00 0x7f7e4c0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48346/0 (socket says 172.21.15.155:48346) 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1376599140 learned_addr learned my addr 172.21.15.155:0/1376599140 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e51256640 1 --2- 172.21.15.155:0/1376599140 >> v2:172.21.15.191:3300/0 conn(0x7f7e4c0b5450 0x7f7e4c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e50a55640 1 --2- 172.21.15.155:0/1376599140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1376599140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 msgr2=0x7f7e4c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 --2- 172.21.15.155:0/1376599140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1376599140 >> v2:172.21.15.191:3300/0 conn(0x7f7e4c0b5450 msgr2=0x7f7e4c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 --2- 172.21.15.155:0/1376599140 >> v2:172.21.15.191:3300/0 conn(0x7f7e4c0b5450 0x7f7e4c0d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1376599140 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c0cb8c0 con 0x7f7e4c0b3c00 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.199+0000 7f7e51256640 1 --2- 172.21.15.155:0/1376599140 >> v2:172.21.15.191:3300/0 conn(0x7f7e4c0b5450 0x7f7e4c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e4bfff640 1 --2- 172.21.15.155:0/1376599140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c0b4f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0caf10 tx=0x7f7e3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b6c65b4e84eb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e4b7fe640 1 -- 172.21.15.155:0/1376599140 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38037070 con 0x7f7e4c0b3c00 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e4b7fe640 1 -- 172.21.15.155:0/1376599140 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e38032440 con 0x7f7e4c0b3c00 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e4b7fe640 1 -- 172.21.15.155:0/1376599140 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38032810 con 0x7f7e4c0b3c00 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1376599140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b3c00 msgr2=0x7f7e4c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1376599140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c0b4f10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0caf10 tx=0x7f7e3802a270 comp rx=0 tx=0).stop 2024-04-25T13:16:51.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1376599140 shutdown_connections 2024-04-25T13:16:51.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1376599140 >> v2:172.21.15.191:3300/0 conn(0x7f7e4c0b5450 0x7f7e4c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1376599140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c0b4f10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1376599140 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.200+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1376599140 >> 172.21.15.155:0/1376599140 conn(0x7f7e4c074d50 msgr2=0x7f7e4c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:51.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.201+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1376599140 shutdown_connections 2024-04-25T13:16:51.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.201+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1376599140 wait complete. 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 Processor -- start 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 -- start start 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c1f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 0x7f7e4c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c0b4430 con 0x7f7e4c0b5450 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.202+0000 7f7e52cb9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c0b4150 con 0x7f7e4c0b3c00 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e52cb9640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c0b4710 con 0x7f7e4c1554e0 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 0x7f7e4c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 0x7f7e4c15cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48352/0 (socket says 172.21.15.155:48352) 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1911768256 learned_addr learned my addr 172.21.15.155:0/1911768256 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e50a55640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c1f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e51256640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 msgr2=0x7f7e4c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e4c0b3c00 msgr2=0x7f7e4c1f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c1f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 -- 172.21.15.155:0/1911768256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c1566a0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e4bfff640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 0x7f7e4c15cdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e3802a2b0 tx=0x7f7e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38041020 con 0x7f7e4c0b5450 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e380306c0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38037040 con 0x7f7e4c0b5450 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c156980 con 0x7f7e4c0b5450 2024-04-25T13:16:51.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.203+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c15c2f0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.204+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4c068e40 con 0x7f7e4c0b5450 2024-04-25T13:16:51.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.205+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e38044020 con 0x7f7e4c0b5450 2024-04-25T13:16:51.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.205+0000 7f7e497fa640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7e3006c8f0 0x7f7e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.205+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7e380ac5b0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.205+0000 7f7e50a55640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7e3006c8f0 0x7f7e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.206+0000 7f7e50a55640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7e3006c8f0 0x7f7e3006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006fd0 tx=0x7f7e40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.210+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e3804b030 con 0x7f7e4c0b5450 2024-04-25T13:16:51.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.385+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e4c0cdfb0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.386+0000 7f7e497fa640 1 -- 172.21.15.155:0/1911768256 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7f7e38079fc0 con 0x7f7e4c0b5450 2024-04-25T13:16:51.387 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:51.387 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7e3006c8f0 msgr2=0x7f7e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7e3006c8f0 0x7f7e3006edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006fd0 tx=0x7f7e40008040 comp rx=0 tx=0).stop 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 msgr2=0x7f7e4c15cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 0x7f7e4c15cdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e3802a2b0 tx=0x7f7e380046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 shutdown_connections 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f7e3006c8f0 0x7f7e3006edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f7e4c1554e0 0x7f7e4c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4c0b5450 0x7f7e4c15cdd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 --2- 172.21.15.155:0/1911768256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7e4c0b3c00 0x7f7e4c1f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 >> 172.21.15.155:0/1911768256 conn(0x7f7e4c074d50 msgr2=0x7f7e4c0cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:51.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 shutdown_connections 2024-04-25T13:16:51.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.389+0000 7f7e52cb9640 1 -- 172.21.15.155:0/1911768256 wait complete. 2024-04-25T13:16:51.400 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:16:51.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:51.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.496+0000 7fdd4f17d640 1 Processor -- start 2024-04-25T13:16:51.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.496+0000 7fdd4f17d640 1 -- start start 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4f17d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fdd4806bb90 0x7fdd4815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4f17d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd480c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4f17d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4815bef0 con 0x7fdd4806bf70 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4f17d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4815f510 con 0x7fdd4806bb90 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4f17d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4815b650 con 0x7fdd480c99f0 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd47fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fdd4806bf70 0x7fdd4815ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:48552/0 (socket says 172.21.15.155:48552) 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd47fff640 1 -- 172.21.15.155:0/2200745867 learned_addr learned my addr 172.21.15.155:0/2200745867 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/2200745867 >> v2:172.21.15.191:3300/0 conn(0x7fdd4806bb90 0x7fdd4815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd4d71a640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd480c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.497+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870898358 0 0) 0x7fdd4815bef0 con 0x7fdd4806bf70 2024-04-25T13:16:51.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd38003520 con 0x7fdd4806bf70 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581626484 0 0) 0x7fdd38003520 con 0x7fdd4806bf70 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 msgr2=0x7fdd480c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd480c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 >> v2:172.21.15.191:3300/0 conn(0x7fdd4806bb90 msgr2=0x7fdd4815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 --2- 172.21.15.155:0/2200745867 >> v2:172.21.15.191:3300/0 conn(0x7fdd4806bb90 0x7fdd4815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4815b930 con 0x7fdd4806bf70 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fdd34001670 con 0x7fdd4806bf70 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 >> v1:172.21.15.155:6789/0 conn(0x7fdd4806bf70 legacy=0x7fdd4815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd38004d40 0x7fdd380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4815f510 con 0x7fdd380039b0 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4815b650 con 0x7fdd38004d40 2024-04-25T13:16:51.501 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3800b9c0 con 0x7fdd480c99f0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4d71a640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd38004d40 0x7fdd380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd47fff640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4cf19640 1 -- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 msgr2=0x7fdd38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4cf19640 1 -- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd38004d40 msgr2=0x7fdd380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd38004d40 0x7fdd380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd4cf19640 1 -- 172.21.15.155:0/2200745867 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd38003520 con 0x7fdd380039b0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.498+0000 7fdd47fff640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd480c99f0 0x7fdd38004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.499+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd38003dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009ac0 tx=0x7fdd38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f216016f3d7812 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.499+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c036070 con 0x7fdd380039b0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.499+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c031400 con 0x7fdd380039b0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.499+0000 7fdd477fe640 1 -- 172.21.15.155:0/2200745867 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c009690 con 0x7fdd380039b0 2024-04-25T13:16:51.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4f17d640 1 -- 172.21.15.155:0/2200745867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 msgr2=0x7fdd38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/2200745867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd38003dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009ac0 tx=0x7fdd38005830 comp rx=0 tx=0).stop 2024-04-25T13:16:51.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4d71a640 1 -- 172.21.15.155:0/2200745867 reap_dead start 2024-04-25T13:16:51.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4f17d640 1 -- 172.21.15.155:0/2200745867 shutdown_connections 2024-04-25T13:16:51.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4f17d640 1 -- 172.21.15.155:0/2200745867 >> 172.21.15.155:0/2200745867 conn(0x7fdd48074d50 msgr2=0x7fdd48075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:51.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4f17d640 1 -- 172.21.15.155:0/2200745867 shutdown_connections 2024-04-25T13:16:51.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.500+0000 7fdd4f17d640 1 -- 172.21.15.155:0/2200745867 wait complete. 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.501+0000 7fdd4f17d640 1 Processor -- start 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.501+0000 7fdd4f17d640 1 -- start start 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd481f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd4815c130 0x7fdd481f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd4814e960 0x7fdd480ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4815e8e0 con 0x7fdd380039b0 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4815e600 con 0x7fdd4815c130 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fdd48074560 con 0x7fdd4814e960 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd481f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd481f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48374/0 (socket says 172.21.15.155:48374) 2024-04-25T13:16:51.506 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 -- 172.21.15.155:0/698894757 learned_addr learned my addr 172.21.15.155:0/698894757 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd47fff640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd4815c130 0x7fdd481f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4d71a640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd4814e960 0x7fdd480ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 -- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd4814e960 msgr2=0x7fdd480ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd4814e960 0x7fdd480ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 -- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd4815c130 msgr2=0x7fdd481f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd4815c130 0x7fdd481f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 -- 172.21.15.155:0/698894757 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd481f0b40 con 0x7fdd380039b0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4d71a640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd4814e960 0x7fdd480ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4cf19640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd481f1600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c034040 tx=0x7fdd3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c040020 con 0x7fdd380039b0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0038d0 con 0x7fdd380039b0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd481f4810 con 0x7fdd380039b0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c036040 con 0x7fdd380039b0 2024-04-25T13:16:51.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.502+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd481f4dd0 con 0x7fdd380039b0 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.503+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd48068e40 con 0x7fdd380039b0 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.504+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd3c043020 con 0x7fdd380039b0 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.504+0000 7fdd457fa640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fdd2c06c920 0x7fdd2c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.504+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdd3c0abec0 con 0x7fdd380039b0 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.504+0000 7fdd47fff640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fdd2c06c920 0x7fdd2c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.505+0000 7fdd47fff640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fdd2c06c920 0x7fdd2c06ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd4814ada0 tx=0x7fdd34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.509+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd3c04a070 con 0x7fdd380039b0 2024-04-25T13:16:51.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.679+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd48071490 con 0x7fdd2c06c920 2024-04-25T13:16:51.687 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.687+0000 7fdd457fa640 1 -- 172.21.15.155:0/698894757 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fdd48071490 con 0x7fdd2c06c920 2024-04-25T13:16:51.692 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:51.694 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fdd2c06c920 msgr2=0x7fdd2c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fdd2c06c920 0x7fdd2c06ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd4814ada0 tx=0x7fdd34009040 comp rx=0 tx=0).stop 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 msgr2=0x7fdd481f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd481f1600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c034040 tx=0x7fdd3c004730 comp rx=0 tx=0).stop 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 shutdown_connections 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fdd2c06c920 0x7fdd2c06ede0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fdd4814e960 0x7fdd480ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd4815c130 0x7fdd481f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 --2- 172.21.15.155:0/698894757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd380039b0 0x7fdd481f1600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 >> 172.21.15.155:0/698894757 conn(0x7fdd48074d50 msgr2=0x7fdd48154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 shutdown_connections 2024-04-25T13:16:51.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.691+0000 7fdd4f17d640 1 -- 172.21.15.155:0/698894757 wait complete. 2024-04-25T13:16:51.702 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T13:16:51.623045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003239"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000719+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:16:27.000719+0000","last_peered":"2024-04-25T13:16:27.000719+0000","last_clean":"2024-04-25T13:16:27.000719+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:16:27.000719+0000","last_undegraded":"2024-04-25T13:16:27.000719+0000","last_fullsized":"2024-04-25T13:16:27.000719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000852+0000","last_change":"2024-04-25T13:16:21.677923+0000","last_active":"2024-04-25T13:16:27.000852+0000","last_peered":"2024-04-25T13:16:27.000852+0000","last_clean":"2024-04-25T13:16:27.000852+0000","last_became_active":"2024-04-25T13:16:21.676720+0000","last_became_peered":"2024-04-25T13:16:21.676720+0000","last_unstale":"2024-04-25T13:16:27.000852+0000","last_undegraded":"2024-04-25T13:16:27.000852+0000","last_fullsized":"2024-04-25T13:16:27.000852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:31.190458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000250+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:16:27.000250+0000","last_peered":"2024-04-25T13:16:27.000250+0000","last_clean":"2024-04-25T13:16:27.000250+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:16:27.000250+0000","last_undegraded":"2024-04-25T13:16:27.000250+0000","last_fullsized":"2024-04-25T13:16:27.000250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001016+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:16:27.001016+0000","last_peered":"2024-04-25T13:16:27.001016+0000","last_clean":"2024-04-25T13:16:27.001016+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:16:27.001016+0000","last_undegraded":"2024-04-25T13:16:27.001016+0000","last_fullsized":"2024-04-25T13:16:27.001016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000593+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:16:27.000593+0000","last_peered":"2024-04-25T13:16:27.000593+0000","last_clean":"2024-04-25T13:16:27.000593+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:16:27.000593+0000","last_undegraded":"2024-04-25T13:16:27.000593+0000","last_fullsized":"2024-04-25T13:16:27.000593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999478+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:16:26.999478+0000","last_peered":"2024-04-25T13:16:26.999478+0000","last_clean":"2024-04-25T13:16:26.999478+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:16:26.999478+0000","last_undegraded":"2024-04-25T13:16:26.999478+0000","last_fullsized":"2024-04-25T13:16:26.999478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687893+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:16:26.687893+0000","last_peered":"2024-04-25T13:16:26.687893+0000","last_clean":"2024-04-25T13:16:26.687893+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:16:26.687893+0000","last_undegraded":"2024-04-25T13:16:26.687893+0000","last_fullsized":"2024-04-25T13:16:26.687893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828472+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:16:26.828472+0000","last_peered":"2024-04-25T13:16:26.828472+0000","last_clean":"2024-04-25T13:16:26.828472+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:16:26.828472+0000","last_undegraded":"2024-04-25T13:16:26.828472+0000","last_fullsized":"2024-04-25T13:16:26.828472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000162+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:16:27.000162+0000","last_peered":"2024-04-25T13:16:27.000162+0000","last_clean":"2024-04-25T13:16:27.000162+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:16:27.000162+0000","last_undegraded":"2024-04-25T13:16:27.000162+0000","last_fullsized":"2024-04-25T13:16:27.000162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688119+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:16:26.688119+0000","last_peered":"2024-04-25T13:16:26.688119+0000","last_clean":"2024-04-25T13:16:26.688119+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:16:26.688119+0000","last_undegraded":"2024-04-25T13:16:26.688119+0000","last_fullsized":"2024-04-25T13:16:26.688119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828686+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:16:26.828686+0000","last_peered":"2024-04-25T13:16:26.828686+0000","last_clean":"2024-04-25T13:16:26.828686+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:16:26.828686+0000","last_undegraded":"2024-04-25T13:16:26.828686+0000","last_fullsized":"2024-04-25T13:16:26.828686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999572+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:16:26.999572+0000","last_peered":"2024-04-25T13:16:26.999572+0000","last_clean":"2024-04-25T13:16:26.999572+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:16:26.999572+0000","last_undegraded":"2024-04-25T13:16:26.999572+0000","last_fullsized":"2024-04-25T13:16:26.999572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688207+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:16:26.688207+0000","last_peered":"2024-04-25T13:16:26.688207+0000","last_clean":"2024-04-25T13:16:26.688207+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:16:26.688207+0000","last_undegraded":"2024-04-25T13:16:26.688207+0000","last_fullsized":"2024-04-25T13:16:26.688207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000138+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:16:27.000138+0000","last_peered":"2024-04-25T13:16:27.000138+0000","last_clean":"2024-04-25T13:16:27.000138+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:16:27.000138+0000","last_undegraded":"2024-04-25T13:16:27.000138+0000","last_fullsized":"2024-04-25T13:16:27.000138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000505+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:16:27.000505+0000","last_peered":"2024-04-25T13:16:27.000505+0000","last_clean":"2024-04-25T13:16:27.000505+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:16:27.000505+0000","last_undegraded":"2024-04-25T13:16:27.000505+0000","last_fullsized":"2024-04-25T13:16:27.000505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687372+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:16:26.687372+0000","last_peered":"2024-04-25T13:16:26.687372+0000","last_clean":"2024-04-25T13:16:26.687372+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:16:26.687372+0000","last_undegraded":"2024-04-25T13:16:26.687372+0000","last_fullsized":"2024-04-25T13:16:26.687372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999884+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:16:26.999884+0000","last_peered":"2024-04-25T13:16:26.999884+0000","last_clean":"2024-04-25T13:16:26.999884+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:16:26.999884+0000","last_undegraded":"2024-04-25T13:16:26.999884+0000","last_fullsized":"2024-04-25T13:16:26.999884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001079+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:16:27.001079+0000","last_peered":"2024-04-25T13:16:27.001079+0000","last_clean":"2024-04-25T13:16:27.001079+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:16:27.001079+0000","last_undegraded":"2024-04-25T13:16:27.001079+0000","last_fullsized":"2024-04-25T13:16:27.001079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687469+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:16:26.687469+0000","last_peered":"2024-04-25T13:16:26.687469+0000","last_clean":"2024-04-25T13:16:26.687469+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:16:26.687469+0000","last_undegraded":"2024-04-25T13:16:26.687469+0000","last_fullsized":"2024-04-25T13:16:26.687469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687887+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:16:26.687887+0000","last_peered":"2024-04-25T13:16:26.687887+0000","last_clean":"2024-04-25T13:16:26.687887+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:16:26.687887+0000","last_undegraded":"2024-04-25T13:16:26.687887+0000","last_fullsized":"2024-04-25T13:16:26.687887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999794+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:16:26.999794+0000","last_peered":"2024-04-25T13:16:26.999794+0000","last_clean":"2024-04-25T13:16:26.999794+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:16:26.999794+0000","last_undegraded":"2024-04-25T13:16:26.999794+0000","last_fullsized":"2024-04-25T13:16:26.999794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000168+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:16:27.000168+0000","last_peered":"2024-04-25T13:16:27.000168+0000","last_clean":"2024-04-25T13:16:27.000168+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:16:27.000168+0000","last_undegraded":"2024-04-25T13:16:27.000168+0000","last_fullsized":"2024-04-25T13:16:27.000168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.689047+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:16:26.689047+0000","last_peered":"2024-04-25T13:16:26.689047+0000","last_clean":"2024-04-25T13:16:26.689047+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:16:26.689047+0000","last_undegraded":"2024-04-25T13:16:26.689047+0000","last_fullsized":"2024-04-25T13:16:26.689047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999769+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:16:26.999769+0000","last_peered":"2024-04-25T13:16:26.999769+0000","last_clean":"2024-04-25T13:16:26.999769+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:16:26.999769+0000","last_undegraded":"2024-04-25T13:16:26.999769+0000","last_fullsized":"2024-04-25T13:16:26.999769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001113+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:16:27.001113+0000","last_peered":"2024-04-25T13:16:27.001113+0000","last_clean":"2024-04-25T13:16:27.001113+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:16:27.001113+0000","last_undegraded":"2024-04-25T13:16:27.001113+0000","last_fullsized":"2024-04-25T13:16:27.001113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687821+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:16:26.687821+0000","last_peered":"2024-04-25T13:16:26.687821+0000","last_clean":"2024-04-25T13:16:26.687821+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:16:26.687821+0000","last_undegraded":"2024-04-25T13:16:26.687821+0000","last_fullsized":"2024-04-25T13:16:26.687821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000811+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:16:27.000811+0000","last_peered":"2024-04-25T13:16:27.000811+0000","last_clean":"2024-04-25T13:16:27.000811+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:16:27.000811+0000","last_undegraded":"2024-04-25T13:16:27.000811+0000","last_fullsized":"2024-04-25T13:16:27.000811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687597+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:16:26.687597+0000","last_peered":"2024-04-25T13:16:26.687597+0000","last_clean":"2024-04-25T13:16:26.687597+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:16:26.687597+0000","last_undegraded":"2024-04-25T13:16:26.687597+0000","last_fullsized":"2024-04-25T13:16:26.687597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688301+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:16:26.688301+0000","last_peered":"2024-04-25T13:16:26.688301+0000","last_clean":"2024-04-25T13:16:26.688301+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:16:26.688301+0000","last_undegraded":"2024-04-25T13:16:26.688301+0000","last_fullsized":"2024-04-25T13:16:26.688301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999752+0000","last_change":"2024-04-25T13:16:25.705945+0000","last_active":"2024-04-25T13:16:26.999752+0000","last_peered":"2024-04-25T13:16:26.999752+0000","last_clean":"2024-04-25T13:16:26.999752+0000","last_became_active":"2024-04-25T13:16:25.705550+0000","last_became_peered":"2024-04-25T13:16:25.705550+0000","last_unstale":"2024-04-25T13:16:26.999752+0000","last_undegraded":"2024-04-25T13:16:26.999752+0000","last_fullsized":"2024-04-25T13:16:26.999752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:30.764317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828828+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:16:26.828828+0000","last_peered":"2024-04-25T13:16:26.828828+0000","last_clean":"2024-04-25T13:16:26.828828+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:16:26.828828+0000","last_undegraded":"2024-04-25T13:16:26.828828+0000","last_fullsized":"2024-04-25T13:16:26.828828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687635+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:16:26.687635+0000","last_peered":"2024-04-25T13:16:26.687635+0000","last_clean":"2024-04-25T13:16:26.687635+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:16:26.687635+0000","last_undegraded":"2024-04-25T13:16:26.687635+0000","last_fullsized":"2024-04-25T13:16:26.687635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687173+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:16:26.687173+0000","last_peered":"2024-04-25T13:16:26.687173+0000","last_clean":"2024-04-25T13:16:26.687173+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:16:26.687173+0000","last_undegraded":"2024-04-25T13:16:26.687173+0000","last_fullsized":"2024-04-25T13:16:26.687173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000094+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:16:27.000094+0000","last_peered":"2024-04-25T13:16:27.000094+0000","last_clean":"2024-04-25T13:16:27.000094+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:16:27.000094+0000","last_undegraded":"2024-04-25T13:16:27.000094+0000","last_fullsized":"2024-04-25T13:16:27.000094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828739+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:16:26.828739+0000","last_peered":"2024-04-25T13:16:26.828739+0000","last_clean":"2024-04-25T13:16:26.828739+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:16:26.828739+0000","last_undegraded":"2024-04-25T13:16:26.828739+0000","last_fullsized":"2024-04-25T13:16:26.828739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:25.709047+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:25.708642+0000","last_became_peered":"2024-04-25T13:16:25.708642+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:08:56.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687295+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:16:26.687295+0000","last_peered":"2024-04-25T13:16:26.687295+0000","last_clean":"2024-04-25T13:16:26.687295+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:16:26.687295+0000","last_undegraded":"2024-04-25T13:16:26.687295+0000","last_fullsized":"2024-04-25T13:16:26.687295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999384+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:16:26.999384+0000","last_peered":"2024-04-25T13:16:26.999384+0000","last_clean":"2024-04-25T13:16:26.999384+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:16:26.999384+0000","last_undegraded":"2024-04-25T13:16:26.999384+0000","last_fullsized":"2024-04-25T13:16:26.999384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687946+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:16:26.687946+0000","last_peered":"2024-04-25T13:16:26.687946+0000","last_clean":"2024-04-25T13:16:26.687946+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:16:26.687946+0000","last_undegraded":"2024-04-25T13:16:26.687946+0000","last_fullsized":"2024-04-25T13:16:26.687946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999439+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:16:26.999439+0000","last_peered":"2024-04-25T13:16:26.999439+0000","last_clean":"2024-04-25T13:16:26.999439+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:16:26.999439+0000","last_undegraded":"2024-04-25T13:16:26.999439+0000","last_fullsized":"2024-04-25T13:16:26.999439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000395+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:16:27.000395+0000","last_peered":"2024-04-25T13:16:27.000395+0000","last_clean":"2024-04-25T13:16:27.000395+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:16:27.000395+0000","last_undegraded":"2024-04-25T13:16:27.000395+0000","last_fullsized":"2024-04-25T13:16:27.000395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000037+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:16:27.000037+0000","last_peered":"2024-04-25T13:16:27.000037+0000","last_clean":"2024-04-25T13:16:27.000037+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:16:27.000037+0000","last_undegraded":"2024-04-25T13:16:27.000037+0000","last_fullsized":"2024-04-25T13:16:27.000037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828455+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:16:26.828455+0000","last_peered":"2024-04-25T13:16:26.828455+0000","last_clean":"2024-04-25T13:16:26.828455+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:16:26.828455+0000","last_undegraded":"2024-04-25T13:16:26.828455+0000","last_fullsized":"2024-04-25T13:16:26.828455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687324+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:16:26.687324+0000","last_peered":"2024-04-25T13:16:26.687324+0000","last_clean":"2024-04-25T13:16:26.687324+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:16:26.687324+0000","last_undegraded":"2024-04-25T13:16:26.687324+0000","last_fullsized":"2024-04-25T13:16:26.687324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688261+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:16:26.688261+0000","last_peered":"2024-04-25T13:16:26.688261+0000","last_clean":"2024-04-25T13:16:26.688261+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:16:26.688261+0000","last_undegraded":"2024-04-25T13:16:26.688261+0000","last_fullsized":"2024-04-25T13:16:26.688261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687709+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:16:26.687709+0000","last_peered":"2024-04-25T13:16:26.687709+0000","last_clean":"2024-04-25T13:16:26.687709+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:16:26.687709+0000","last_undegraded":"2024-04-25T13:16:26.687709+0000","last_fullsized":"2024-04-25T13:16:26.687709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000780+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:16:27.000780+0000","last_peered":"2024-04-25T13:16:27.000780+0000","last_clean":"2024-04-25T13:16:27.000780+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:16:27.000780+0000","last_undegraded":"2024-04-25T13:16:27.000780+0000","last_fullsized":"2024-04-25T13:16:27.000780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687526+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:16:26.687526+0000","last_peered":"2024-04-25T13:16:26.687526+0000","last_clean":"2024-04-25T13:16:26.687526+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:16:26.687526+0000","last_undegraded":"2024-04-25T13:16:26.687526+0000","last_fullsized":"2024-04-25T13:16:26.687526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828608+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:16:26.828608+0000","last_peered":"2024-04-25T13:16:26.828608+0000","last_clean":"2024-04-25T13:16:26.828608+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:16:26.828608+0000","last_undegraded":"2024-04-25T13:16:26.828608+0000","last_fullsized":"2024-04-25T13:16:26.828608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687640+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:16:26.687640+0000","last_peered":"2024-04-25T13:16:26.687640+0000","last_clean":"2024-04-25T13:16:26.687640+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:16:26.687640+0000","last_undegraded":"2024-04-25T13:16:26.687640+0000","last_fullsized":"2024-04-25T13:16:26.687640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999890+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:16:26.999890+0000","last_peered":"2024-04-25T13:16:26.999890+0000","last_clean":"2024-04-25T13:16:26.999890+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:16:26.999890+0000","last_undegraded":"2024-04-25T13:16:26.999890+0000","last_fullsized":"2024-04-25T13:16:26.999890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688905+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:16:26.688905+0000","last_peered":"2024-04-25T13:16:26.688905+0000","last_clean":"2024-04-25T13:16:26.688905+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:16:26.688905+0000","last_undegraded":"2024-04-25T13:16:26.688905+0000","last_fullsized":"2024-04-25T13:16:26.688905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999838+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:16:26.999838+0000","last_peered":"2024-04-25T13:16:26.999838+0000","last_clean":"2024-04-25T13:16:26.999838+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:16:26.999838+0000","last_undegraded":"2024-04-25T13:16:26.999838+0000","last_fullsized":"2024-04-25T13:16:26.999838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828257+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:16:26.828257+0000","last_peered":"2024-04-25T13:16:26.828257+0000","last_clean":"2024-04-25T13:16:26.828257+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:16:26.828257+0000","last_undegraded":"2024-04-25T13:16:26.828257+0000","last_fullsized":"2024-04-25T13:16:26.828257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687921+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:16:26.687921+0000","last_peered":"2024-04-25T13:16:26.687921+0000","last_clean":"2024-04-25T13:16:26.687921+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:16:26.687921+0000","last_undegraded":"2024-04-25T13:16:26.687921+0000","last_fullsized":"2024-04-25T13:16:26.687921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000245+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:16:27.000245+0000","last_peered":"2024-04-25T13:16:27.000245+0000","last_clean":"2024-04-25T13:16:27.000245+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:16:27.000245+0000","last_undegraded":"2024-04-25T13:16:27.000245+0000","last_fullsized":"2024-04-25T13:16:27.000245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999436+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:16:26.999436+0000","last_peered":"2024-04-25T13:16:26.999436+0000","last_clean":"2024-04-25T13:16:26.999436+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:16:26.999436+0000","last_undegraded":"2024-04-25T13:16:26.999436+0000","last_fullsized":"2024-04-25T13:16:26.999436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999066+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:16:26.999066+0000","last_peered":"2024-04-25T13:16:26.999066+0000","last_clean":"2024-04-25T13:16:26.999066+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:16:26.999066+0000","last_undegraded":"2024-04-25T13:16:26.999066+0000","last_fullsized":"2024-04-25T13:16:26.999066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000256+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:16:27.000256+0000","last_peered":"2024-04-25T13:16:27.000256+0000","last_clean":"2024-04-25T13:16:27.000256+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:16:27.000256+0000","last_undegraded":"2024-04-25T13:16:27.000256+0000","last_fullsized":"2024-04-25T13:16:27.000256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688254+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:16:26.688254+0000","last_peered":"2024-04-25T13:16:26.688254+0000","last_clean":"2024-04-25T13:16:26.688254+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:16:26.688254+0000","last_undegraded":"2024-04-25T13:16:26.688254+0000","last_fullsized":"2024-04-25T13:16:26.688254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687675+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:16:26.687675+0000","last_peered":"2024-04-25T13:16:26.687675+0000","last_clean":"2024-04-25T13:16:26.687675+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:16:26.687675+0000","last_undegraded":"2024-04-25T13:16:26.687675+0000","last_fullsized":"2024-04-25T13:16:26.687675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001041+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:16:27.001041+0000","last_peered":"2024-04-25T13:16:27.001041+0000","last_clean":"2024-04-25T13:16:27.001041+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:16:27.001041+0000","last_undegraded":"2024-04-25T13:16:27.001041+0000","last_fullsized":"2024-04-25T13:16:27.001041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688112+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:16:26.688112+0000","last_peered":"2024-04-25T13:16:26.688112+0000","last_clean":"2024-04-25T13:16:26.688112+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:16:26.688112+0000","last_undegraded":"2024-04-25T13:16:26.688112+0000","last_fullsized":"2024-04-25T13:16:26.688112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828735+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:16:26.828735+0000","last_peered":"2024-04-25T13:16:26.828735+0000","last_clean":"2024-04-25T13:16:26.828735+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:16:26.828735+0000","last_undegraded":"2024-04-25T13:16:26.828735+0000","last_fullsized":"2024-04-25T13:16:26.828735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000341+0000","last_change":"2024-04-25T13:16:25.709677+0000","last_active":"2024-04-25T13:16:27.000341+0000","last_peered":"2024-04-25T13:16:27.000341+0000","last_clean":"2024-04-25T13:16:27.000341+0000","last_became_active":"2024-04-25T13:16:25.707247+0000","last_became_peered":"2024-04-25T13:16:25.707247+0000","last_unstale":"2024-04-25T13:16:27.000341+0000","last_undegraded":"2024-04-25T13:16:27.000341+0000","last_fullsized":"2024-04-25T13:16:27.000341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:37.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999611+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:16:26.999611+0000","last_peered":"2024-04-25T13:16:26.999611+0000","last_clean":"2024-04-25T13:16:26.999611+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:16:26.999611+0000","last_undegraded":"2024-04-25T13:16:26.999611+0000","last_fullsized":"2024-04-25T13:16:26.999611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999938+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:16:26.999938+0000","last_peered":"2024-04-25T13:16:26.999938+0000","last_clean":"2024-04-25T13:16:26.999938+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:16:26.999938+0000","last_undegraded":"2024-04-25T13:16:26.999938+0000","last_fullsized":"2024-04-25T13:16:26.999938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828759+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:16:26.828759+0000","last_peered":"2024-04-25T13:16:26.828759+0000","last_clean":"2024-04-25T13:16:26.828759+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:16:26.828759+0000","last_undegraded":"2024-04-25T13:16:26.828759+0000","last_fullsized":"2024-04-25T13:16:26.828759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687616+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:16:26.687616+0000","last_peered":"2024-04-25T13:16:26.687616+0000","last_clean":"2024-04-25T13:16:26.687616+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:16:26.687616+0000","last_undegraded":"2024-04-25T13:16:26.687616+0000","last_fullsized":"2024-04-25T13:16:26.687616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:36.096330+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:16:36.096330+0000","last_peered":"2024-04-25T13:16:36.096330+0000","last_clean":"2024-04-25T13:16:36.096330+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:16:36.096330+0000","last_undegraded":"2024-04-25T13:16:36.096330+0000","last_fullsized":"2024-04-25T13:16:36.096330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687301+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:16:26.687301+0000","last_peered":"2024-04-25T13:16:26.687301+0000","last_clean":"2024-04-25T13:16:26.687301+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:16:26.687301+0000","last_undegraded":"2024-04-25T13:16:26.687301+0000","last_fullsized":"2024-04-25T13:16:26.687301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999970+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:16:26.999970+0000","last_peered":"2024-04-25T13:16:26.999970+0000","last_clean":"2024-04-25T13:16:26.999970+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:16:26.999970+0000","last_undegraded":"2024-04-25T13:16:26.999970+0000","last_fullsized":"2024-04-25T13:16:26.999970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687595+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:16:26.687595+0000","last_peered":"2024-04-25T13:16:26.687595+0000","last_clean":"2024-04-25T13:16:26.687595+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:16:26.687595+0000","last_undegraded":"2024-04-25T13:16:26.687595+0000","last_fullsized":"2024-04-25T13:16:26.687595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999908+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:16:26.999908+0000","last_peered":"2024-04-25T13:16:26.999908+0000","last_clean":"2024-04-25T13:16:26.999908+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:16:26.999908+0000","last_undegraded":"2024-04-25T13:16:26.999908+0000","last_fullsized":"2024-04-25T13:16:26.999908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000683+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:16:27.000683+0000","last_peered":"2024-04-25T13:16:27.000683+0000","last_clean":"2024-04-25T13:16:27.000683+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:16:27.000683+0000","last_undegraded":"2024-04-25T13:16:27.000683+0000","last_fullsized":"2024-04-25T13:16:27.000683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828848+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:16:26.828848+0000","last_peered":"2024-04-25T13:16:26.828848+0000","last_clean":"2024-04-25T13:16:26.828848+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:16:26.828848+0000","last_undegraded":"2024-04-25T13:16:26.828848+0000","last_fullsized":"2024-04-25T13:16:26.828848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001032+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:16:27.001032+0000","last_peered":"2024-04-25T13:16:27.001032+0000","last_clean":"2024-04-25T13:16:27.001032+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:16:27.001032+0000","last_undegraded":"2024-04-25T13:16:27.001032+0000","last_fullsized":"2024-04-25T13:16:27.001032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828856+0000","last_change":"2024-04-25T13:16:21.665570+0000","last_active":"2024-04-25T13:16:26.828856+0000","last_peered":"2024-04-25T13:16:26.828856+0000","last_clean":"2024-04-25T13:16:26.828856+0000","last_became_active":"2024-04-25T13:16:21.665168+0000","last_became_peered":"2024-04-25T13:16:21.665168+0000","last_unstale":"2024-04-25T13:16:26.828856+0000","last_undegraded":"2024-04-25T13:16:26.828856+0000","last_fullsized":"2024-04-25T13:16:26.828856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:10.029372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688617+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:16:26.688617+0000","last_peered":"2024-04-25T13:16:26.688617+0000","last_clean":"2024-04-25T13:16:26.688617+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:16:26.688617+0000","last_undegraded":"2024-04-25T13:16:26.688617+0000","last_fullsized":"2024-04-25T13:16:26.688617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000409+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:16:27.000409+0000","last_peered":"2024-04-25T13:16:27.000409+0000","last_clean":"2024-04-25T13:16:27.000409+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:16:27.000409+0000","last_undegraded":"2024-04-25T13:16:27.000409+0000","last_fullsized":"2024-04-25T13:16:27.000409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000112+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:16:27.000112+0000","last_peered":"2024-04-25T13:16:27.000112+0000","last_clean":"2024-04-25T13:16:27.000112+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:16:27.000112+0000","last_undegraded":"2024-04-25T13:16:27.000112+0000","last_fullsized":"2024-04-25T13:16:27.000112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687005+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:16:26.687005+0000","last_peered":"2024-04-25T13:16:26.687005+0000","last_clean":"2024-04-25T13:16:26.687005+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:16:26.687005+0000","last_undegraded":"2024-04-25T13:16:26.687005+0000","last_fullsized":"2024-04-25T13:16:26.687005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828401+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:16:26.828401+0000","last_peered":"2024-04-25T13:16:26.828401+0000","last_clean":"2024-04-25T13:16:26.828401+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:16:26.828401+0000","last_undegraded":"2024-04-25T13:16:26.828401+0000","last_fullsized":"2024-04-25T13:16:26.828401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688528+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:16:26.688528+0000","last_peered":"2024-04-25T13:16:26.688528+0000","last_clean":"2024-04-25T13:16:26.688528+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:16:26.688528+0000","last_undegraded":"2024-04-25T13:16:26.688528+0000","last_fullsized":"2024-04-25T13:16:26.688528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001000+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:16:27.001000+0000","last_peered":"2024-04-25T13:16:27.001000+0000","last_clean":"2024-04-25T13:16:27.001000+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:16:27.001000+0000","last_undegraded":"2024-04-25T13:16:27.001000+0000","last_fullsized":"2024-04-25T13:16:27.001000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000623+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:16:27.000623+0000","last_peered":"2024-04-25T13:16:27.000623+0000","last_clean":"2024-04-25T13:16:27.000623+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:16:27.000623+0000","last_undegraded":"2024-04-25T13:16:27.000623+0000","last_fullsized":"2024-04-25T13:16:27.000623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688455+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:16:26.688455+0000","last_peered":"2024-04-25T13:16:26.688455+0000","last_clean":"2024-04-25T13:16:26.688455+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:16:26.688455+0000","last_undegraded":"2024-04-25T13:16:26.688455+0000","last_fullsized":"2024-04-25T13:16:26.688455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999914+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:16:26.999914+0000","last_peered":"2024-04-25T13:16:26.999914+0000","last_clean":"2024-04-25T13:16:26.999914+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:16:26.999914+0000","last_undegraded":"2024-04-25T13:16:26.999914+0000","last_fullsized":"2024-04-25T13:16:26.999914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999479+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:16:26.999479+0000","last_peered":"2024-04-25T13:16:26.999479+0000","last_clean":"2024-04-25T13:16:26.999479+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:16:26.999479+0000","last_undegraded":"2024-04-25T13:16:26.999479+0000","last_fullsized":"2024-04-25T13:16:26.999479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000587+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:16:27.000587+0000","last_peered":"2024-04-25T13:16:27.000587+0000","last_clean":"2024-04-25T13:16:27.000587+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:16:27.000587+0000","last_undegraded":"2024-04-25T13:16:27.000587+0000","last_fullsized":"2024-04-25T13:16:27.000587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999648+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:16:26.999648+0000","last_peered":"2024-04-25T13:16:26.999648+0000","last_clean":"2024-04-25T13:16:26.999648+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:16:26.999648+0000","last_undegraded":"2024-04-25T13:16:26.999648+0000","last_fullsized":"2024-04-25T13:16:26.999648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000307+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:16:27.000307+0000","last_peered":"2024-04-25T13:16:27.000307+0000","last_clean":"2024-04-25T13:16:27.000307+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:16:27.000307+0000","last_undegraded":"2024-04-25T13:16:27.000307+0000","last_fullsized":"2024-04-25T13:16:27.000307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687291+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:16:26.687291+0000","last_peered":"2024-04-25T13:16:26.687291+0000","last_clean":"2024-04-25T13:16:26.687291+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:16:26.687291+0000","last_undegraded":"2024-04-25T13:16:26.687291+0000","last_fullsized":"2024-04-25T13:16:26.687291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999304+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:16:26.999304+0000","last_peered":"2024-04-25T13:16:26.999304+0000","last_clean":"2024-04-25T13:16:26.999304+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:16:26.999304+0000","last_undegraded":"2024-04-25T13:16:26.999304+0000","last_fullsized":"2024-04-25T13:16:26.999304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828575+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:16:26.828575+0000","last_peered":"2024-04-25T13:16:26.828575+0000","last_clean":"2024-04-25T13:16:26.828575+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:16:26.828575+0000","last_undegraded":"2024-04-25T13:16:26.828575+0000","last_fullsized":"2024-04-25T13:16:26.828575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999830+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:16:26.999830+0000","last_peered":"2024-04-25T13:16:26.999830+0000","last_clean":"2024-04-25T13:16:26.999830+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:16:26.999830+0000","last_undegraded":"2024-04-25T13:16:26.999830+0000","last_fullsized":"2024-04-25T13:16:26.999830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688587+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:16:26.688587+0000","last_peered":"2024-04-25T13:16:26.688587+0000","last_clean":"2024-04-25T13:16:26.688587+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:16:26.688587+0000","last_undegraded":"2024-04-25T13:16:26.688587+0000","last_fullsized":"2024-04-25T13:16:26.688587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001087+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:16:27.001087+0000","last_peered":"2024-04-25T13:16:27.001087+0000","last_clean":"2024-04-25T13:16:27.001087+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:16:27.001087+0000","last_undegraded":"2024-04-25T13:16:27.001087+0000","last_fullsized":"2024-04-25T13:16:27.001087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828304+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:16:26.828304+0000","last_peered":"2024-04-25T13:16:26.828304+0000","last_clean":"2024-04-25T13:16:26.828304+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:16:26.828304+0000","last_undegraded":"2024-04-25T13:16:26.828304+0000","last_fullsized":"2024-04-25T13:16:26.828304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000461+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:16:27.000461+0000","last_peered":"2024-04-25T13:16:27.000461+0000","last_clean":"2024-04-25T13:16:27.000461+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:16:27.000461+0000","last_undegraded":"2024-04-25T13:16:27.000461+0000","last_fullsized":"2024-04-25T13:16:27.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828566+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:16:26.828566+0000","last_peered":"2024-04-25T13:16:26.828566+0000","last_clean":"2024-04-25T13:16:26.828566+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:16:26.828566+0000","last_undegraded":"2024-04-25T13:16:26.828566+0000","last_fullsized":"2024-04-25T13:16:26.828566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999722+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:16:26.999722+0000","last_peered":"2024-04-25T13:16:26.999722+0000","last_clean":"2024-04-25T13:16:26.999722+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:16:26.999722+0000","last_undegraded":"2024-04-25T13:16:26.999722+0000","last_fullsized":"2024-04-25T13:16:26.999722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688999+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:16:26.688999+0000","last_peered":"2024-04-25T13:16:26.688999+0000","last_clean":"2024-04-25T13:16:26.688999+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:16:26.688999+0000","last_undegraded":"2024-04-25T13:16:26.688999+0000","last_fullsized":"2024-04-25T13:16:26.688999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688200+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:16:26.688200+0000","last_peered":"2024-04-25T13:16:26.688200+0000","last_clean":"2024-04-25T13:16:26.688200+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:16:26.688200+0000","last_undegraded":"2024-04-25T13:16:26.688200+0000","last_fullsized":"2024-04-25T13:16:26.688200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999798+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:16:26.999798+0000","last_peered":"2024-04-25T13:16:26.999798+0000","last_clean":"2024-04-25T13:16:26.999798+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:26.999798+0000","last_undegraded":"2024-04-25T13:16:26.999798+0000","last_fullsized":"2024-04-25T13:16:26.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828947+0000","last_change":"2024-04-25T13:16:21.666904+0000","last_active":"2024-04-25T13:16:26.828947+0000","last_peered":"2024-04-25T13:16:26.828947+0000","last_clean":"2024-04-25T13:16:26.828947+0000","last_became_active":"2024-04-25T13:16:21.666638+0000","last_became_peered":"2024-04-25T13:16:21.666638+0000","last_unstale":"2024-04-25T13:16:26.828947+0000","last_undegraded":"2024-04-25T13:16:26.828947+0000","last_fullsized":"2024-04-25T13:16:26.828947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:54.740696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828197+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:16:26.828197+0000","last_peered":"2024-04-25T13:16:26.828197+0000","last_clean":"2024-04-25T13:16:26.828197+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:16:26.828197+0000","last_undegraded":"2024-04-25T13:16:26.828197+0000","last_fullsized":"2024-04-25T13:16:26.828197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687381+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:16:26.687381+0000","last_peered":"2024-04-25T13:16:26.687381+0000","last_clean":"2024-04-25T13:16:26.687381+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:16:26.687381+0000","last_undegraded":"2024-04-25T13:16:26.687381+0000","last_fullsized":"2024-04-25T13:16:26.687381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999585+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:16:26.999585+0000","last_peered":"2024-04-25T13:16:26.999585+0000","last_clean":"2024-04-25T13:16:26.999585+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:16:26.999585+0000","last_undegraded":"2024-04-25T13:16:26.999585+0000","last_fullsized":"2024-04-25T13:16:26.999585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000418+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:16:27.000418+0000","last_peered":"2024-04-25T13:16:27.000418+0000","last_clean":"2024-04-25T13:16:27.000418+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:27.000418+0000","last_undegraded":"2024-04-25T13:16:27.000418+0000","last_fullsized":"2024-04-25T13:16:27.000418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999907+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:16:26.999907+0000","last_peered":"2024-04-25T13:16:26.999907+0000","last_clean":"2024-04-25T13:16:26.999907+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:16:26.999907+0000","last_undegraded":"2024-04-25T13:16:26.999907+0000","last_fullsized":"2024-04-25T13:16:26.999907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688332+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:16:26.688332+0000","last_peered":"2024-04-25T13:16:26.688332+0000","last_clean":"2024-04-25T13:16:26.688332+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:16:26.688332+0000","last_undegraded":"2024-04-25T13:16:26.688332+0000","last_fullsized":"2024-04-25T13:16:26.688332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688469+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:16:26.688469+0000","last_peered":"2024-04-25T13:16:26.688469+0000","last_clean":"2024-04-25T13:16:26.688469+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:16:26.688469+0000","last_undegraded":"2024-04-25T13:16:26.688469+0000","last_fullsized":"2024-04-25T13:16:26.688469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688862+0000","last_change":"2024-04-25T13:16:21.665463+0000","last_active":"2024-04-25T13:16:26.688862+0000","last_peered":"2024-04-25T13:16:26.688862+0000","last_clean":"2024-04-25T13:16:26.688862+0000","last_became_active":"2024-04-25T13:16:21.665120+0000","last_became_peered":"2024-04-25T13:16:21.665120+0000","last_unstale":"2024-04-25T13:16:26.688862+0000","last_undegraded":"2024-04-25T13:16:26.688862+0000","last_fullsized":"2024-04-25T13:16:26.688862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:33.552291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000878+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:16:27.000878+0000","last_peered":"2024-04-25T13:16:27.000878+0000","last_clean":"2024-04-25T13:16:27.000878+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:16:27.000878+0000","last_undegraded":"2024-04-25T13:16:27.000878+0000","last_fullsized":"2024-04-25T13:16:27.000878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687369+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:16:26.687369+0000","last_peered":"2024-04-25T13:16:26.687369+0000","last_clean":"2024-04-25T13:16:26.687369+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:16:26.687369+0000","last_undegraded":"2024-04-25T13:16:26.687369+0000","last_fullsized":"2024-04-25T13:16:26.687369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828382+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:16:26.828382+0000","last_peered":"2024-04-25T13:16:26.828382+0000","last_clean":"2024-04-25T13:16:26.828382+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:16:26.828382+0000","last_undegraded":"2024-04-25T13:16:26.828382+0000","last_fullsized":"2024-04-25T13:16:26.828382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687907+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:16:26.687907+0000","last_peered":"2024-04-25T13:16:26.687907+0000","last_clean":"2024-04-25T13:16:26.687907+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:16:26.687907+0000","last_undegraded":"2024-04-25T13:16:26.687907+0000","last_fullsized":"2024-04-25T13:16:26.687907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828456+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:16:26.828456+0000","last_peered":"2024-04-25T13:16:26.828456+0000","last_clean":"2024-04-25T13:16:26.828456+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:16:26.828456+0000","last_undegraded":"2024-04-25T13:16:26.828456+0000","last_fullsized":"2024-04-25T13:16:26.828456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999773+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:16:26.999773+0000","last_peered":"2024-04-25T13:16:26.999773+0000","last_clean":"2024-04-25T13:16:26.999773+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:16:26.999773+0000","last_undegraded":"2024-04-25T13:16:26.999773+0000","last_fullsized":"2024-04-25T13:16:26.999773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687734+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:16:26.687734+0000","last_peered":"2024-04-25T13:16:26.687734+0000","last_clean":"2024-04-25T13:16:26.687734+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:16:26.687734+0000","last_undegraded":"2024-04-25T13:16:26.687734+0000","last_fullsized":"2024-04-25T13:16:26.687734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688481+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:16:26.688481+0000","last_peered":"2024-04-25T13:16:26.688481+0000","last_clean":"2024-04-25T13:16:26.688481+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:16:26.688481+0000","last_undegraded":"2024-04-25T13:16:26.688481+0000","last_fullsized":"2024-04-25T13:16:26.688481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:51.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.841+0000 7fa45efbb640 1 Processor -- start 2024-04-25T13:16:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.841+0000 7fa45efbb640 1 -- start start 2024-04-25T13:16:51.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45efbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa45815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45efbb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4580c99f0 0x7fa4580c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45efbb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45815bef0 con 0x7fa45806bf70 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45efbb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa45815f510 con 0x7fa4580c99f0 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45efbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa45815b650 con 0x7fa45806bb90 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4580c99f0 0x7fa4580c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4580c99f0 0x7fa4580c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48388/0 (socket says 172.21.15.155:48388) 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 -- 172.21.15.155:0/3553041410 learned_addr learned my addr 172.21.15.155:0/3553041410 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45cd57640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa45815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 -- 172.21.15.155:0/3553041410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 msgr2=0x7fa45815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa45815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 -- 172.21.15.155:0/3553041410 >> v1:172.21.15.191:6789/0 conn(0x7fa45806bf70 legacy=0x7fa45815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45d558640 1 -- 172.21.15.155:0/3553041410 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45815b930 con 0x7fa4580c99f0 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.842+0000 7fa45cd57640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa45815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45d558640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4580c99f0 0x7fa4580c9e80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa450009e50 tx=0x7fa45002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca512ac604d490 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa4577fe640 1 -- 172.21.15.155:0/3553041410 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450036070 con 0x7fa4580c99f0 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa4577fe640 1 -- 172.21.15.155:0/3553041410 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa450031600 con 0x7fa4580c99f0 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa4577fe640 1 -- 172.21.15.155:0/3553041410 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500319d0 con 0x7fa4580c99f0 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 -- 172.21.15.155:0/3553041410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4580c99f0 msgr2=0x7fa4580c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4580c99f0 0x7fa4580c9e80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa450009e50 tx=0x7fa45002a7a0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 -- 172.21.15.155:0/3553041410 shutdown_connections 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4580c99f0 0x7fa4580c9e80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 --2- 172.21.15.155:0/3553041410 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa45815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 -- 172.21.15.155:0/3553041410 >> 172.21.15.155:0/3553041410 conn(0x7fa458074d50 msgr2=0x7fa458075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 -- 172.21.15.155:0/3553041410 shutdown_connections 2024-04-25T13:16:51.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.843+0000 7fa45efbb640 1 -- 172.21.15.155:0/3553041410 wait complete. 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.844+0000 7fa45efbb640 1 Processor -- start 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.844+0000 7fa45efbb640 1 -- start start 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45efbb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa4581e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45efbb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 0x7fa4580ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45efbb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4580c99f0 0x7fa4581e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45efbb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa45815e8e0 con 0x7fa45806bf70 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45efbb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa45815e600 con 0x7fa4580c99f0 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45efbb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa458074560 con 0x7fa45806bb90 2024-04-25T13:16:51.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa457fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 0x7fa4580ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa457fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 0x7fa4580ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48396/0 (socket says 172.21.15.155:48396) 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa457fff640 1 -- 172.21.15.155:0/4003198380 learned_addr learned my addr 172.21.15.155:0/4003198380 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.845+0000 7fa45cd57640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa4581e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa45d558640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4580c99f0 0x7fa4581e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa457fff640 1 -- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 msgr2=0x7fa4581e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa457fff640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa4581e6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa457fff640 1 -- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4580c99f0 msgr2=0x7fa4581e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa457fff640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4580c99f0 0x7fa4581e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa457fff640 1 -- 172.21.15.155:0/4003198380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4581f3eb0 con 0x7fa45806bf70 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa457fff640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 0x7fa4580ce910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c430 tx=0x7fa44400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4440052d0 con 0x7fa45806bf70 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444005490 con 0x7fa45806bf70 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581f4a10 con 0x7fa45806bf70 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444007260 con 0x7fa45806bf70 2024-04-25T13:16:51.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.846+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4581f4450 con 0x7fa45806bf70 2024-04-25T13:16:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.847+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa458068e40 con 0x7fa45806bf70 2024-04-25T13:16:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.847+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa444007400 con 0x7fa45806bf70 2024-04-25T13:16:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.848+0000 7fa4557fa640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa43c06c8f0 0x7fa43c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.848+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa44408b2d0 con 0x7fa45806bf70 2024-04-25T13:16:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.848+0000 7fa45cd57640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa43c06c8f0 0x7fa43c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:51.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.848+0000 7fa45cd57640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa43c06c8f0 0x7fa43c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00ab60 tx=0x7fa44c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:51.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:51.852+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa444058e00 con 0x7fa45806bf70 2024-04-25T13:16:52.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.023+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa45806df60 con 0x7fa43c06c8f0 2024-04-25T13:16:52.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.030+0000 7fa4557fa640 1 -- 172.21.15.155:0/4003198380 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fa45806df60 con 0x7fa43c06c8f0 2024-04-25T13:16:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:52.035 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.033+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa43c06c8f0 msgr2=0x7fa43c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.033+0000 7fa45efbb640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa43c06c8f0 0x7fa43c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00ab60 tx=0x7fa44c008040 comp rx=0 tx=0).stop 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.033+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 msgr2=0x7fa4580ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.033+0000 7fa45efbb640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 0x7fa4580ce910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c430 tx=0x7fa44400c8f0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 shutdown_connections 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4580c99f0 0x7fa4581e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45806bf70 0x7fa4580ce910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa43c06c8f0 0x7fa43c06edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 --2- 172.21.15.155:0/4003198380 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa45806bb90 0x7fa4581e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 >> 172.21.15.155:0/4003198380 conn(0x7fa458074d50 msgr2=0x7fa458073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 shutdown_connections 2024-04-25T13:16:52.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.034+0000 7fa45efbb640 1 -- 172.21.15.155:0/4003198380 wait complete. 2024-04-25T13:16:52.044 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T13:16:51.623045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003239"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000719+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:16:27.000719+0000","last_peered":"2024-04-25T13:16:27.000719+0000","last_clean":"2024-04-25T13:16:27.000719+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:16:27.000719+0000","last_undegraded":"2024-04-25T13:16:27.000719+0000","last_fullsized":"2024-04-25T13:16:27.000719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000852+0000","last_change":"2024-04-25T13:16:21.677923+0000","last_active":"2024-04-25T13:16:27.000852+0000","last_peered":"2024-04-25T13:16:27.000852+0000","last_clean":"2024-04-25T13:16:27.000852+0000","last_became_active":"2024-04-25T13:16:21.676720+0000","last_became_peered":"2024-04-25T13:16:21.676720+0000","last_unstale":"2024-04-25T13:16:27.000852+0000","last_undegraded":"2024-04-25T13:16:27.000852+0000","last_fullsized":"2024-04-25T13:16:27.000852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:31.190458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000250+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:16:27.000250+0000","last_peered":"2024-04-25T13:16:27.000250+0000","last_clean":"2024-04-25T13:16:27.000250+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:16:27.000250+0000","last_undegraded":"2024-04-25T13:16:27.000250+0000","last_fullsized":"2024-04-25T13:16:27.000250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001016+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:16:27.001016+0000","last_peered":"2024-04-25T13:16:27.001016+0000","last_clean":"2024-04-25T13:16:27.001016+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:16:27.001016+0000","last_undegraded":"2024-04-25T13:16:27.001016+0000","last_fullsized":"2024-04-25T13:16:27.001016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000593+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:16:27.000593+0000","last_peered":"2024-04-25T13:16:27.000593+0000","last_clean":"2024-04-25T13:16:27.000593+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:16:27.000593+0000","last_undegraded":"2024-04-25T13:16:27.000593+0000","last_fullsized":"2024-04-25T13:16:27.000593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999478+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:16:26.999478+0000","last_peered":"2024-04-25T13:16:26.999478+0000","last_clean":"2024-04-25T13:16:26.999478+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:16:26.999478+0000","last_undegraded":"2024-04-25T13:16:26.999478+0000","last_fullsized":"2024-04-25T13:16:26.999478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687893+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:16:26.687893+0000","last_peered":"2024-04-25T13:16:26.687893+0000","last_clean":"2024-04-25T13:16:26.687893+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:16:26.687893+0000","last_undegraded":"2024-04-25T13:16:26.687893+0000","last_fullsized":"2024-04-25T13:16:26.687893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828472+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:16:26.828472+0000","last_peered":"2024-04-25T13:16:26.828472+0000","last_clean":"2024-04-25T13:16:26.828472+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:16:26.828472+0000","last_undegraded":"2024-04-25T13:16:26.828472+0000","last_fullsized":"2024-04-25T13:16:26.828472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000162+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:16:27.000162+0000","last_peered":"2024-04-25T13:16:27.000162+0000","last_clean":"2024-04-25T13:16:27.000162+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:16:27.000162+0000","last_undegraded":"2024-04-25T13:16:27.000162+0000","last_fullsized":"2024-04-25T13:16:27.000162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688119+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:16:26.688119+0000","last_peered":"2024-04-25T13:16:26.688119+0000","last_clean":"2024-04-25T13:16:26.688119+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:16:26.688119+0000","last_undegraded":"2024-04-25T13:16:26.688119+0000","last_fullsized":"2024-04-25T13:16:26.688119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828686+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:16:26.828686+0000","last_peered":"2024-04-25T13:16:26.828686+0000","last_clean":"2024-04-25T13:16:26.828686+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:16:26.828686+0000","last_undegraded":"2024-04-25T13:16:26.828686+0000","last_fullsized":"2024-04-25T13:16:26.828686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999572+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:16:26.999572+0000","last_peered":"2024-04-25T13:16:26.999572+0000","last_clean":"2024-04-25T13:16:26.999572+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:16:26.999572+0000","last_undegraded":"2024-04-25T13:16:26.999572+0000","last_fullsized":"2024-04-25T13:16:26.999572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688207+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:16:26.688207+0000","last_peered":"2024-04-25T13:16:26.688207+0000","last_clean":"2024-04-25T13:16:26.688207+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:16:26.688207+0000","last_undegraded":"2024-04-25T13:16:26.688207+0000","last_fullsized":"2024-04-25T13:16:26.688207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000138+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:16:27.000138+0000","last_peered":"2024-04-25T13:16:27.000138+0000","last_clean":"2024-04-25T13:16:27.000138+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:16:27.000138+0000","last_undegraded":"2024-04-25T13:16:27.000138+0000","last_fullsized":"2024-04-25T13:16:27.000138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000505+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:16:27.000505+0000","last_peered":"2024-04-25T13:16:27.000505+0000","last_clean":"2024-04-25T13:16:27.000505+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:16:27.000505+0000","last_undegraded":"2024-04-25T13:16:27.000505+0000","last_fullsized":"2024-04-25T13:16:27.000505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687372+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:16:26.687372+0000","last_peered":"2024-04-25T13:16:26.687372+0000","last_clean":"2024-04-25T13:16:26.687372+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:16:26.687372+0000","last_undegraded":"2024-04-25T13:16:26.687372+0000","last_fullsized":"2024-04-25T13:16:26.687372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999884+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:16:26.999884+0000","last_peered":"2024-04-25T13:16:26.999884+0000","last_clean":"2024-04-25T13:16:26.999884+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:16:26.999884+0000","last_undegraded":"2024-04-25T13:16:26.999884+0000","last_fullsized":"2024-04-25T13:16:26.999884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001079+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:16:27.001079+0000","last_peered":"2024-04-25T13:16:27.001079+0000","last_clean":"2024-04-25T13:16:27.001079+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:16:27.001079+0000","last_undegraded":"2024-04-25T13:16:27.001079+0000","last_fullsized":"2024-04-25T13:16:27.001079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687469+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:16:26.687469+0000","last_peered":"2024-04-25T13:16:26.687469+0000","last_clean":"2024-04-25T13:16:26.687469+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:16:26.687469+0000","last_undegraded":"2024-04-25T13:16:26.687469+0000","last_fullsized":"2024-04-25T13:16:26.687469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687887+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:16:26.687887+0000","last_peered":"2024-04-25T13:16:26.687887+0000","last_clean":"2024-04-25T13:16:26.687887+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:16:26.687887+0000","last_undegraded":"2024-04-25T13:16:26.687887+0000","last_fullsized":"2024-04-25T13:16:26.687887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999794+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:16:26.999794+0000","last_peered":"2024-04-25T13:16:26.999794+0000","last_clean":"2024-04-25T13:16:26.999794+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:16:26.999794+0000","last_undegraded":"2024-04-25T13:16:26.999794+0000","last_fullsized":"2024-04-25T13:16:26.999794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000168+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:16:27.000168+0000","last_peered":"2024-04-25T13:16:27.000168+0000","last_clean":"2024-04-25T13:16:27.000168+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:16:27.000168+0000","last_undegraded":"2024-04-25T13:16:27.000168+0000","last_fullsized":"2024-04-25T13:16:27.000168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.689047+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:16:26.689047+0000","last_peered":"2024-04-25T13:16:26.689047+0000","last_clean":"2024-04-25T13:16:26.689047+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:16:26.689047+0000","last_undegraded":"2024-04-25T13:16:26.689047+0000","last_fullsized":"2024-04-25T13:16:26.689047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999769+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:16:26.999769+0000","last_peered":"2024-04-25T13:16:26.999769+0000","last_clean":"2024-04-25T13:16:26.999769+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:16:26.999769+0000","last_undegraded":"2024-04-25T13:16:26.999769+0000","last_fullsized":"2024-04-25T13:16:26.999769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001113+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:16:27.001113+0000","last_peered":"2024-04-25T13:16:27.001113+0000","last_clean":"2024-04-25T13:16:27.001113+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:16:27.001113+0000","last_undegraded":"2024-04-25T13:16:27.001113+0000","last_fullsized":"2024-04-25T13:16:27.001113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687821+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:16:26.687821+0000","last_peered":"2024-04-25T13:16:26.687821+0000","last_clean":"2024-04-25T13:16:26.687821+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:16:26.687821+0000","last_undegraded":"2024-04-25T13:16:26.687821+0000","last_fullsized":"2024-04-25T13:16:26.687821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000811+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:16:27.000811+0000","last_peered":"2024-04-25T13:16:27.000811+0000","last_clean":"2024-04-25T13:16:27.000811+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:16:27.000811+0000","last_undegraded":"2024-04-25T13:16:27.000811+0000","last_fullsized":"2024-04-25T13:16:27.000811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687597+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:16:26.687597+0000","last_peered":"2024-04-25T13:16:26.687597+0000","last_clean":"2024-04-25T13:16:26.687597+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:16:26.687597+0000","last_undegraded":"2024-04-25T13:16:26.687597+0000","last_fullsized":"2024-04-25T13:16:26.687597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688301+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:16:26.688301+0000","last_peered":"2024-04-25T13:16:26.688301+0000","last_clean":"2024-04-25T13:16:26.688301+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:16:26.688301+0000","last_undegraded":"2024-04-25T13:16:26.688301+0000","last_fullsized":"2024-04-25T13:16:26.688301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999752+0000","last_change":"2024-04-25T13:16:25.705945+0000","last_active":"2024-04-25T13:16:26.999752+0000","last_peered":"2024-04-25T13:16:26.999752+0000","last_clean":"2024-04-25T13:16:26.999752+0000","last_became_active":"2024-04-25T13:16:25.705550+0000","last_became_peered":"2024-04-25T13:16:25.705550+0000","last_unstale":"2024-04-25T13:16:26.999752+0000","last_undegraded":"2024-04-25T13:16:26.999752+0000","last_fullsized":"2024-04-25T13:16:26.999752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:30.764317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828828+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:16:26.828828+0000","last_peered":"2024-04-25T13:16:26.828828+0000","last_clean":"2024-04-25T13:16:26.828828+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:16:26.828828+0000","last_undegraded":"2024-04-25T13:16:26.828828+0000","last_fullsized":"2024-04-25T13:16:26.828828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687635+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:16:26.687635+0000","last_peered":"2024-04-25T13:16:26.687635+0000","last_clean":"2024-04-25T13:16:26.687635+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:16:26.687635+0000","last_undegraded":"2024-04-25T13:16:26.687635+0000","last_fullsized":"2024-04-25T13:16:26.687635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687173+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:16:26.687173+0000","last_peered":"2024-04-25T13:16:26.687173+0000","last_clean":"2024-04-25T13:16:26.687173+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:16:26.687173+0000","last_undegraded":"2024-04-25T13:16:26.687173+0000","last_fullsized":"2024-04-25T13:16:26.687173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000094+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:16:27.000094+0000","last_peered":"2024-04-25T13:16:27.000094+0000","last_clean":"2024-04-25T13:16:27.000094+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:16:27.000094+0000","last_undegraded":"2024-04-25T13:16:27.000094+0000","last_fullsized":"2024-04-25T13:16:27.000094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828739+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:16:26.828739+0000","last_peered":"2024-04-25T13:16:26.828739+0000","last_clean":"2024-04-25T13:16:26.828739+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:16:26.828739+0000","last_undegraded":"2024-04-25T13:16:26.828739+0000","last_fullsized":"2024-04-25T13:16:26.828739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:25.709047+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:25.708642+0000","last_became_peered":"2024-04-25T13:16:25.708642+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:08:56.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687295+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:16:26.687295+0000","last_peered":"2024-04-25T13:16:26.687295+0000","last_clean":"2024-04-25T13:16:26.687295+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:16:26.687295+0000","last_undegraded":"2024-04-25T13:16:26.687295+0000","last_fullsized":"2024-04-25T13:16:26.687295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999384+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:16:26.999384+0000","last_peered":"2024-04-25T13:16:26.999384+0000","last_clean":"2024-04-25T13:16:26.999384+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:16:26.999384+0000","last_undegraded":"2024-04-25T13:16:26.999384+0000","last_fullsized":"2024-04-25T13:16:26.999384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687946+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:16:26.687946+0000","last_peered":"2024-04-25T13:16:26.687946+0000","last_clean":"2024-04-25T13:16:26.687946+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:16:26.687946+0000","last_undegraded":"2024-04-25T13:16:26.687946+0000","last_fullsized":"2024-04-25T13:16:26.687946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999439+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:16:26.999439+0000","last_peered":"2024-04-25T13:16:26.999439+0000","last_clean":"2024-04-25T13:16:26.999439+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:16:26.999439+0000","last_undegraded":"2024-04-25T13:16:26.999439+0000","last_fullsized":"2024-04-25T13:16:26.999439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000395+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:16:27.000395+0000","last_peered":"2024-04-25T13:16:27.000395+0000","last_clean":"2024-04-25T13:16:27.000395+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:16:27.000395+0000","last_undegraded":"2024-04-25T13:16:27.000395+0000","last_fullsized":"2024-04-25T13:16:27.000395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000037+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:16:27.000037+0000","last_peered":"2024-04-25T13:16:27.000037+0000","last_clean":"2024-04-25T13:16:27.000037+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:16:27.000037+0000","last_undegraded":"2024-04-25T13:16:27.000037+0000","last_fullsized":"2024-04-25T13:16:27.000037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828455+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:16:26.828455+0000","last_peered":"2024-04-25T13:16:26.828455+0000","last_clean":"2024-04-25T13:16:26.828455+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:16:26.828455+0000","last_undegraded":"2024-04-25T13:16:26.828455+0000","last_fullsized":"2024-04-25T13:16:26.828455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687324+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:16:26.687324+0000","last_peered":"2024-04-25T13:16:26.687324+0000","last_clean":"2024-04-25T13:16:26.687324+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:16:26.687324+0000","last_undegraded":"2024-04-25T13:16:26.687324+0000","last_fullsized":"2024-04-25T13:16:26.687324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688261+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:16:26.688261+0000","last_peered":"2024-04-25T13:16:26.688261+0000","last_clean":"2024-04-25T13:16:26.688261+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:16:26.688261+0000","last_undegraded":"2024-04-25T13:16:26.688261+0000","last_fullsized":"2024-04-25T13:16:26.688261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687709+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:16:26.687709+0000","last_peered":"2024-04-25T13:16:26.687709+0000","last_clean":"2024-04-25T13:16:26.687709+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:16:26.687709+0000","last_undegraded":"2024-04-25T13:16:26.687709+0000","last_fullsized":"2024-04-25T13:16:26.687709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000780+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:16:27.000780+0000","last_peered":"2024-04-25T13:16:27.000780+0000","last_clean":"2024-04-25T13:16:27.000780+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:16:27.000780+0000","last_undegraded":"2024-04-25T13:16:27.000780+0000","last_fullsized":"2024-04-25T13:16:27.000780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687526+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:16:26.687526+0000","last_peered":"2024-04-25T13:16:26.687526+0000","last_clean":"2024-04-25T13:16:26.687526+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:16:26.687526+0000","last_undegraded":"2024-04-25T13:16:26.687526+0000","last_fullsized":"2024-04-25T13:16:26.687526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828608+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:16:26.828608+0000","last_peered":"2024-04-25T13:16:26.828608+0000","last_clean":"2024-04-25T13:16:26.828608+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:16:26.828608+0000","last_undegraded":"2024-04-25T13:16:26.828608+0000","last_fullsized":"2024-04-25T13:16:26.828608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687640+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:16:26.687640+0000","last_peered":"2024-04-25T13:16:26.687640+0000","last_clean":"2024-04-25T13:16:26.687640+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:16:26.687640+0000","last_undegraded":"2024-04-25T13:16:26.687640+0000","last_fullsized":"2024-04-25T13:16:26.687640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999890+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:16:26.999890+0000","last_peered":"2024-04-25T13:16:26.999890+0000","last_clean":"2024-04-25T13:16:26.999890+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:16:26.999890+0000","last_undegraded":"2024-04-25T13:16:26.999890+0000","last_fullsized":"2024-04-25T13:16:26.999890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688905+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:16:26.688905+0000","last_peered":"2024-04-25T13:16:26.688905+0000","last_clean":"2024-04-25T13:16:26.688905+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:16:26.688905+0000","last_undegraded":"2024-04-25T13:16:26.688905+0000","last_fullsized":"2024-04-25T13:16:26.688905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999838+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:16:26.999838+0000","last_peered":"2024-04-25T13:16:26.999838+0000","last_clean":"2024-04-25T13:16:26.999838+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:16:26.999838+0000","last_undegraded":"2024-04-25T13:16:26.999838+0000","last_fullsized":"2024-04-25T13:16:26.999838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828257+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:16:26.828257+0000","last_peered":"2024-04-25T13:16:26.828257+0000","last_clean":"2024-04-25T13:16:26.828257+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:16:26.828257+0000","last_undegraded":"2024-04-25T13:16:26.828257+0000","last_fullsized":"2024-04-25T13:16:26.828257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687921+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:16:26.687921+0000","last_peered":"2024-04-25T13:16:26.687921+0000","last_clean":"2024-04-25T13:16:26.687921+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:16:26.687921+0000","last_undegraded":"2024-04-25T13:16:26.687921+0000","last_fullsized":"2024-04-25T13:16:26.687921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000245+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:16:27.000245+0000","last_peered":"2024-04-25T13:16:27.000245+0000","last_clean":"2024-04-25T13:16:27.000245+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:16:27.000245+0000","last_undegraded":"2024-04-25T13:16:27.000245+0000","last_fullsized":"2024-04-25T13:16:27.000245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999436+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:16:26.999436+0000","last_peered":"2024-04-25T13:16:26.999436+0000","last_clean":"2024-04-25T13:16:26.999436+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:16:26.999436+0000","last_undegraded":"2024-04-25T13:16:26.999436+0000","last_fullsized":"2024-04-25T13:16:26.999436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999066+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:16:26.999066+0000","last_peered":"2024-04-25T13:16:26.999066+0000","last_clean":"2024-04-25T13:16:26.999066+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:16:26.999066+0000","last_undegraded":"2024-04-25T13:16:26.999066+0000","last_fullsized":"2024-04-25T13:16:26.999066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000256+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:16:27.000256+0000","last_peered":"2024-04-25T13:16:27.000256+0000","last_clean":"2024-04-25T13:16:27.000256+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:16:27.000256+0000","last_undegraded":"2024-04-25T13:16:27.000256+0000","last_fullsized":"2024-04-25T13:16:27.000256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688254+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:16:26.688254+0000","last_peered":"2024-04-25T13:16:26.688254+0000","last_clean":"2024-04-25T13:16:26.688254+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:16:26.688254+0000","last_undegraded":"2024-04-25T13:16:26.688254+0000","last_fullsized":"2024-04-25T13:16:26.688254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687675+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:16:26.687675+0000","last_peered":"2024-04-25T13:16:26.687675+0000","last_clean":"2024-04-25T13:16:26.687675+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:16:26.687675+0000","last_undegraded":"2024-04-25T13:16:26.687675+0000","last_fullsized":"2024-04-25T13:16:26.687675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001041+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:16:27.001041+0000","last_peered":"2024-04-25T13:16:27.001041+0000","last_clean":"2024-04-25T13:16:27.001041+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:16:27.001041+0000","last_undegraded":"2024-04-25T13:16:27.001041+0000","last_fullsized":"2024-04-25T13:16:27.001041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688112+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:16:26.688112+0000","last_peered":"2024-04-25T13:16:26.688112+0000","last_clean":"2024-04-25T13:16:26.688112+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:16:26.688112+0000","last_undegraded":"2024-04-25T13:16:26.688112+0000","last_fullsized":"2024-04-25T13:16:26.688112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828735+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:16:26.828735+0000","last_peered":"2024-04-25T13:16:26.828735+0000","last_clean":"2024-04-25T13:16:26.828735+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:16:26.828735+0000","last_undegraded":"2024-04-25T13:16:26.828735+0000","last_fullsized":"2024-04-25T13:16:26.828735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000341+0000","last_change":"2024-04-25T13:16:25.709677+0000","last_active":"2024-04-25T13:16:27.000341+0000","last_peered":"2024-04-25T13:16:27.000341+0000","last_clean":"2024-04-25T13:16:27.000341+0000","last_became_active":"2024-04-25T13:16:25.707247+0000","last_became_peered":"2024-04-25T13:16:25.707247+0000","last_unstale":"2024-04-25T13:16:27.000341+0000","last_undegraded":"2024-04-25T13:16:27.000341+0000","last_fullsized":"2024-04-25T13:16:27.000341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:37.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999611+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:16:26.999611+0000","last_peered":"2024-04-25T13:16:26.999611+0000","last_clean":"2024-04-25T13:16:26.999611+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:16:26.999611+0000","last_undegraded":"2024-04-25T13:16:26.999611+0000","last_fullsized":"2024-04-25T13:16:26.999611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999938+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:16:26.999938+0000","last_peered":"2024-04-25T13:16:26.999938+0000","last_clean":"2024-04-25T13:16:26.999938+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:16:26.999938+0000","last_undegraded":"2024-04-25T13:16:26.999938+0000","last_fullsized":"2024-04-25T13:16:26.999938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828759+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:16:26.828759+0000","last_peered":"2024-04-25T13:16:26.828759+0000","last_clean":"2024-04-25T13:16:26.828759+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:16:26.828759+0000","last_undegraded":"2024-04-25T13:16:26.828759+0000","last_fullsized":"2024-04-25T13:16:26.828759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687616+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:16:26.687616+0000","last_peered":"2024-04-25T13:16:26.687616+0000","last_clean":"2024-04-25T13:16:26.687616+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:16:26.687616+0000","last_undegraded":"2024-04-25T13:16:26.687616+0000","last_fullsized":"2024-04-25T13:16:26.687616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:36.096330+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:16:36.096330+0000","last_peered":"2024-04-25T13:16:36.096330+0000","last_clean":"2024-04-25T13:16:36.096330+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:16:36.096330+0000","last_undegraded":"2024-04-25T13:16:36.096330+0000","last_fullsized":"2024-04-25T13:16:36.096330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687301+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:16:26.687301+0000","last_peered":"2024-04-25T13:16:26.687301+0000","last_clean":"2024-04-25T13:16:26.687301+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:16:26.687301+0000","last_undegraded":"2024-04-25T13:16:26.687301+0000","last_fullsized":"2024-04-25T13:16:26.687301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999970+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:16:26.999970+0000","last_peered":"2024-04-25T13:16:26.999970+0000","last_clean":"2024-04-25T13:16:26.999970+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:16:26.999970+0000","last_undegraded":"2024-04-25T13:16:26.999970+0000","last_fullsized":"2024-04-25T13:16:26.999970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687595+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:16:26.687595+0000","last_peered":"2024-04-25T13:16:26.687595+0000","last_clean":"2024-04-25T13:16:26.687595+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:16:26.687595+0000","last_undegraded":"2024-04-25T13:16:26.687595+0000","last_fullsized":"2024-04-25T13:16:26.687595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999908+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:16:26.999908+0000","last_peered":"2024-04-25T13:16:26.999908+0000","last_clean":"2024-04-25T13:16:26.999908+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:16:26.999908+0000","last_undegraded":"2024-04-25T13:16:26.999908+0000","last_fullsized":"2024-04-25T13:16:26.999908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000683+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:16:27.000683+0000","last_peered":"2024-04-25T13:16:27.000683+0000","last_clean":"2024-04-25T13:16:27.000683+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:16:27.000683+0000","last_undegraded":"2024-04-25T13:16:27.000683+0000","last_fullsized":"2024-04-25T13:16:27.000683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828848+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:16:26.828848+0000","last_peered":"2024-04-25T13:16:26.828848+0000","last_clean":"2024-04-25T13:16:26.828848+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:16:26.828848+0000","last_undegraded":"2024-04-25T13:16:26.828848+0000","last_fullsized":"2024-04-25T13:16:26.828848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001032+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:16:27.001032+0000","last_peered":"2024-04-25T13:16:27.001032+0000","last_clean":"2024-04-25T13:16:27.001032+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:16:27.001032+0000","last_undegraded":"2024-04-25T13:16:27.001032+0000","last_fullsized":"2024-04-25T13:16:27.001032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828856+0000","last_change":"2024-04-25T13:16:21.665570+0000","last_active":"2024-04-25T13:16:26.828856+0000","last_peered":"2024-04-25T13:16:26.828856+0000","last_clean":"2024-04-25T13:16:26.828856+0000","last_became_active":"2024-04-25T13:16:21.665168+0000","last_became_peered":"2024-04-25T13:16:21.665168+0000","last_unstale":"2024-04-25T13:16:26.828856+0000","last_undegraded":"2024-04-25T13:16:26.828856+0000","last_fullsized":"2024-04-25T13:16:26.828856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:10.029372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688617+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:16:26.688617+0000","last_peered":"2024-04-25T13:16:26.688617+0000","last_clean":"2024-04-25T13:16:26.688617+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:16:26.688617+0000","last_undegraded":"2024-04-25T13:16:26.688617+0000","last_fullsized":"2024-04-25T13:16:26.688617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000409+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:16:27.000409+0000","last_peered":"2024-04-25T13:16:27.000409+0000","last_clean":"2024-04-25T13:16:27.000409+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:16:27.000409+0000","last_undegraded":"2024-04-25T13:16:27.000409+0000","last_fullsized":"2024-04-25T13:16:27.000409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000112+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:16:27.000112+0000","last_peered":"2024-04-25T13:16:27.000112+0000","last_clean":"2024-04-25T13:16:27.000112+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:16:27.000112+0000","last_undegraded":"2024-04-25T13:16:27.000112+0000","last_fullsized":"2024-04-25T13:16:27.000112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687005+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:16:26.687005+0000","last_peered":"2024-04-25T13:16:26.687005+0000","last_clean":"2024-04-25T13:16:26.687005+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:16:26.687005+0000","last_undegraded":"2024-04-25T13:16:26.687005+0000","last_fullsized":"2024-04-25T13:16:26.687005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828401+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:16:26.828401+0000","last_peered":"2024-04-25T13:16:26.828401+0000","last_clean":"2024-04-25T13:16:26.828401+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:16:26.828401+0000","last_undegraded":"2024-04-25T13:16:26.828401+0000","last_fullsized":"2024-04-25T13:16:26.828401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688528+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:16:26.688528+0000","last_peered":"2024-04-25T13:16:26.688528+0000","last_clean":"2024-04-25T13:16:26.688528+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:16:26.688528+0000","last_undegraded":"2024-04-25T13:16:26.688528+0000","last_fullsized":"2024-04-25T13:16:26.688528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001000+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:16:27.001000+0000","last_peered":"2024-04-25T13:16:27.001000+0000","last_clean":"2024-04-25T13:16:27.001000+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:16:27.001000+0000","last_undegraded":"2024-04-25T13:16:27.001000+0000","last_fullsized":"2024-04-25T13:16:27.001000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000623+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:16:27.000623+0000","last_peered":"2024-04-25T13:16:27.000623+0000","last_clean":"2024-04-25T13:16:27.000623+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:16:27.000623+0000","last_undegraded":"2024-04-25T13:16:27.000623+0000","last_fullsized":"2024-04-25T13:16:27.000623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688455+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:16:26.688455+0000","last_peered":"2024-04-25T13:16:26.688455+0000","last_clean":"2024-04-25T13:16:26.688455+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:16:26.688455+0000","last_undegraded":"2024-04-25T13:16:26.688455+0000","last_fullsized":"2024-04-25T13:16:26.688455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999914+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:16:26.999914+0000","last_peered":"2024-04-25T13:16:26.999914+0000","last_clean":"2024-04-25T13:16:26.999914+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:16:26.999914+0000","last_undegraded":"2024-04-25T13:16:26.999914+0000","last_fullsized":"2024-04-25T13:16:26.999914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999479+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:16:26.999479+0000","last_peered":"2024-04-25T13:16:26.999479+0000","last_clean":"2024-04-25T13:16:26.999479+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:16:26.999479+0000","last_undegraded":"2024-04-25T13:16:26.999479+0000","last_fullsized":"2024-04-25T13:16:26.999479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000587+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:16:27.000587+0000","last_peered":"2024-04-25T13:16:27.000587+0000","last_clean":"2024-04-25T13:16:27.000587+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:16:27.000587+0000","last_undegraded":"2024-04-25T13:16:27.000587+0000","last_fullsized":"2024-04-25T13:16:27.000587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999648+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:16:26.999648+0000","last_peered":"2024-04-25T13:16:26.999648+0000","last_clean":"2024-04-25T13:16:26.999648+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:16:26.999648+0000","last_undegraded":"2024-04-25T13:16:26.999648+0000","last_fullsized":"2024-04-25T13:16:26.999648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000307+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:16:27.000307+0000","last_peered":"2024-04-25T13:16:27.000307+0000","last_clean":"2024-04-25T13:16:27.000307+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:16:27.000307+0000","last_undegraded":"2024-04-25T13:16:27.000307+0000","last_fullsized":"2024-04-25T13:16:27.000307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687291+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:16:26.687291+0000","last_peered":"2024-04-25T13:16:26.687291+0000","last_clean":"2024-04-25T13:16:26.687291+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:16:26.687291+0000","last_undegraded":"2024-04-25T13:16:26.687291+0000","last_fullsized":"2024-04-25T13:16:26.687291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999304+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:16:26.999304+0000","last_peered":"2024-04-25T13:16:26.999304+0000","last_clean":"2024-04-25T13:16:26.999304+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:16:26.999304+0000","last_undegraded":"2024-04-25T13:16:26.999304+0000","last_fullsized":"2024-04-25T13:16:26.999304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828575+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:16:26.828575+0000","last_peered":"2024-04-25T13:16:26.828575+0000","last_clean":"2024-04-25T13:16:26.828575+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:16:26.828575+0000","last_undegraded":"2024-04-25T13:16:26.828575+0000","last_fullsized":"2024-04-25T13:16:26.828575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999830+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:16:26.999830+0000","last_peered":"2024-04-25T13:16:26.999830+0000","last_clean":"2024-04-25T13:16:26.999830+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:16:26.999830+0000","last_undegraded":"2024-04-25T13:16:26.999830+0000","last_fullsized":"2024-04-25T13:16:26.999830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688587+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:16:26.688587+0000","last_peered":"2024-04-25T13:16:26.688587+0000","last_clean":"2024-04-25T13:16:26.688587+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:16:26.688587+0000","last_undegraded":"2024-04-25T13:16:26.688587+0000","last_fullsized":"2024-04-25T13:16:26.688587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001087+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:16:27.001087+0000","last_peered":"2024-04-25T13:16:27.001087+0000","last_clean":"2024-04-25T13:16:27.001087+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:16:27.001087+0000","last_undegraded":"2024-04-25T13:16:27.001087+0000","last_fullsized":"2024-04-25T13:16:27.001087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828304+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:16:26.828304+0000","last_peered":"2024-04-25T13:16:26.828304+0000","last_clean":"2024-04-25T13:16:26.828304+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:16:26.828304+0000","last_undegraded":"2024-04-25T13:16:26.828304+0000","last_fullsized":"2024-04-25T13:16:26.828304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000461+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:16:27.000461+0000","last_peered":"2024-04-25T13:16:27.000461+0000","last_clean":"2024-04-25T13:16:27.000461+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:16:27.000461+0000","last_undegraded":"2024-04-25T13:16:27.000461+0000","last_fullsized":"2024-04-25T13:16:27.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828566+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:16:26.828566+0000","last_peered":"2024-04-25T13:16:26.828566+0000","last_clean":"2024-04-25T13:16:26.828566+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:16:26.828566+0000","last_undegraded":"2024-04-25T13:16:26.828566+0000","last_fullsized":"2024-04-25T13:16:26.828566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999722+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:16:26.999722+0000","last_peered":"2024-04-25T13:16:26.999722+0000","last_clean":"2024-04-25T13:16:26.999722+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:16:26.999722+0000","last_undegraded":"2024-04-25T13:16:26.999722+0000","last_fullsized":"2024-04-25T13:16:26.999722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688999+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:16:26.688999+0000","last_peered":"2024-04-25T13:16:26.688999+0000","last_clean":"2024-04-25T13:16:26.688999+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:16:26.688999+0000","last_undegraded":"2024-04-25T13:16:26.688999+0000","last_fullsized":"2024-04-25T13:16:26.688999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688200+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:16:26.688200+0000","last_peered":"2024-04-25T13:16:26.688200+0000","last_clean":"2024-04-25T13:16:26.688200+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:16:26.688200+0000","last_undegraded":"2024-04-25T13:16:26.688200+0000","last_fullsized":"2024-04-25T13:16:26.688200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999798+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:16:26.999798+0000","last_peered":"2024-04-25T13:16:26.999798+0000","last_clean":"2024-04-25T13:16:26.999798+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:26.999798+0000","last_undegraded":"2024-04-25T13:16:26.999798+0000","last_fullsized":"2024-04-25T13:16:26.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828947+0000","last_change":"2024-04-25T13:16:21.666904+0000","last_active":"2024-04-25T13:16:26.828947+0000","last_peered":"2024-04-25T13:16:26.828947+0000","last_clean":"2024-04-25T13:16:26.828947+0000","last_became_active":"2024-04-25T13:16:21.666638+0000","last_became_peered":"2024-04-25T13:16:21.666638+0000","last_unstale":"2024-04-25T13:16:26.828947+0000","last_undegraded":"2024-04-25T13:16:26.828947+0000","last_fullsized":"2024-04-25T13:16:26.828947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:54.740696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828197+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:16:26.828197+0000","last_peered":"2024-04-25T13:16:26.828197+0000","last_clean":"2024-04-25T13:16:26.828197+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:16:26.828197+0000","last_undegraded":"2024-04-25T13:16:26.828197+0000","last_fullsized":"2024-04-25T13:16:26.828197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687381+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:16:26.687381+0000","last_peered":"2024-04-25T13:16:26.687381+0000","last_clean":"2024-04-25T13:16:26.687381+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:16:26.687381+0000","last_undegraded":"2024-04-25T13:16:26.687381+0000","last_fullsized":"2024-04-25T13:16:26.687381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999585+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:16:26.999585+0000","last_peered":"2024-04-25T13:16:26.999585+0000","last_clean":"2024-04-25T13:16:26.999585+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:16:26.999585+0000","last_undegraded":"2024-04-25T13:16:26.999585+0000","last_fullsized":"2024-04-25T13:16:26.999585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000418+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:16:27.000418+0000","last_peered":"2024-04-25T13:16:27.000418+0000","last_clean":"2024-04-25T13:16:27.000418+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:27.000418+0000","last_undegraded":"2024-04-25T13:16:27.000418+0000","last_fullsized":"2024-04-25T13:16:27.000418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999907+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:16:26.999907+0000","last_peered":"2024-04-25T13:16:26.999907+0000","last_clean":"2024-04-25T13:16:26.999907+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:16:26.999907+0000","last_undegraded":"2024-04-25T13:16:26.999907+0000","last_fullsized":"2024-04-25T13:16:26.999907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688332+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:16:26.688332+0000","last_peered":"2024-04-25T13:16:26.688332+0000","last_clean":"2024-04-25T13:16:26.688332+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:16:26.688332+0000","last_undegraded":"2024-04-25T13:16:26.688332+0000","last_fullsized":"2024-04-25T13:16:26.688332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688469+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:16:26.688469+0000","last_peered":"2024-04-25T13:16:26.688469+0000","last_clean":"2024-04-25T13:16:26.688469+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:16:26.688469+0000","last_undegraded":"2024-04-25T13:16:26.688469+0000","last_fullsized":"2024-04-25T13:16:26.688469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688862+0000","last_change":"2024-04-25T13:16:21.665463+0000","last_active":"2024-04-25T13:16:26.688862+0000","last_peered":"2024-04-25T13:16:26.688862+0000","last_clean":"2024-04-25T13:16:26.688862+0000","last_became_active":"2024-04-25T13:16:21.665120+0000","last_became_peered":"2024-04-25T13:16:21.665120+0000","last_unstale":"2024-04-25T13:16:26.688862+0000","last_undegraded":"2024-04-25T13:16:26.688862+0000","last_fullsized":"2024-04-25T13:16:26.688862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:33.552291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000878+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:16:27.000878+0000","last_peered":"2024-04-25T13:16:27.000878+0000","last_clean":"2024-04-25T13:16:27.000878+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:16:27.000878+0000","last_undegraded":"2024-04-25T13:16:27.000878+0000","last_fullsized":"2024-04-25T13:16:27.000878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687369+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:16:26.687369+0000","last_peered":"2024-04-25T13:16:26.687369+0000","last_clean":"2024-04-25T13:16:26.687369+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:16:26.687369+0000","last_undegraded":"2024-04-25T13:16:26.687369+0000","last_fullsized":"2024-04-25T13:16:26.687369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828382+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:16:26.828382+0000","last_peered":"2024-04-25T13:16:26.828382+0000","last_clean":"2024-04-25T13:16:26.828382+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:16:26.828382+0000","last_undegraded":"2024-04-25T13:16:26.828382+0000","last_fullsized":"2024-04-25T13:16:26.828382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687907+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:16:26.687907+0000","last_peered":"2024-04-25T13:16:26.687907+0000","last_clean":"2024-04-25T13:16:26.687907+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:16:26.687907+0000","last_undegraded":"2024-04-25T13:16:26.687907+0000","last_fullsized":"2024-04-25T13:16:26.687907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828456+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:16:26.828456+0000","last_peered":"2024-04-25T13:16:26.828456+0000","last_clean":"2024-04-25T13:16:26.828456+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:16:26.828456+0000","last_undegraded":"2024-04-25T13:16:26.828456+0000","last_fullsized":"2024-04-25T13:16:26.828456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999773+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:16:26.999773+0000","last_peered":"2024-04-25T13:16:26.999773+0000","last_clean":"2024-04-25T13:16:26.999773+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:16:26.999773+0000","last_undegraded":"2024-04-25T13:16:26.999773+0000","last_fullsized":"2024-04-25T13:16:26.999773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687734+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:16:26.687734+0000","last_peered":"2024-04-25T13:16:26.687734+0000","last_clean":"2024-04-25T13:16:26.687734+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:16:26.687734+0000","last_undegraded":"2024-04-25T13:16:26.687734+0000","last_fullsized":"2024-04-25T13:16:26.687734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688481+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:16:26.688481+0000","last_peered":"2024-04-25T13:16:26.688481+0000","last_clean":"2024-04-25T13:16:26.688481+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:16:26.688481+0000","last_undegraded":"2024-04-25T13:16:26.688481+0000","last_fullsized":"2024-04-25T13:16:26.688481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:52.049 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:16:52.049 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T13:16:52.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T13:16:52.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T13:16:52.050 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T13:16:52.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.182+0000 7f4a54719640 1 Processor -- start 2024-04-25T13:16:52.182 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.182+0000 7f4a54719640 1 -- start start 2024-04-25T13:16:52.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a54719640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4a4c152f70 0x7f4a4c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a54719640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 0x7f4a4c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a54719640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a4c158fe0 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a54719640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4a4c1592c0 con 0x7f4a4c152f70 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a54719640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4a4c1595a0 con 0x7f4a4c0c8870 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a51cb4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 0x7f4a4c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a524b5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4a4c152f70 0x7f4a4c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a52cb6640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f4a4c15c4c0 0x7f4a4c15c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:58298/0 (socket says 172.21.15.155:58298) 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a524b5640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4a4c152f70 0x7f4a4c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:45574/0 (socket says 172.21.15.155:45574) 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a52cb6640 1 -- 172.21.15.155:0/1183157496 learned_addr learned my addr 172.21.15.155:0/1183157496 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a51cb4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 0x7f4a4c0c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:44504/0 (socket says 172.21.15.155:44504) 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a51cb4640 1 -- 172.21.15.155:0/1183157496 >> v2:172.21.15.191:3300/0 conn(0x7f4a4c152f70 msgr2=0x7f4a4c0c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a51cb4640 1 --2- 172.21.15.155:0/1183157496 >> v2:172.21.15.191:3300/0 conn(0x7f4a4c152f70 0x7f4a4c0c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.183+0000 7f4a51cb4640 1 -- 172.21.15.155:0/1183157496 >> v1:172.21.15.191:6789/0 conn(0x7f4a4c15c4c0 legacy=0x7f4a4c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.184+0000 7f4a51cb4640 1 -- 172.21.15.155:0/1183157496 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4c159880 con 0x7f4a4c0c8870 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.184+0000 7f4a51cb4640 1 --2- 172.21.15.155:0/1183157496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 0x7f4a4c0c6090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0097a0 tx=0x7f4a3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830832ac924f3d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.184+0000 7f4a514b3640 1 -- 172.21.15.155:0/1183157496 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c037070 con 0x7f4a4c0c8870 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.184+0000 7f4a514b3640 1 -- 172.21.15.155:0/1183157496 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c032440 con 0x7f4a4c0c8870 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.184+0000 7f4a514b3640 1 -- 172.21.15.155:0/1183157496 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c032810 con 0x7f4a4c0c8870 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 -- 172.21.15.155:0/1183157496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 msgr2=0x7f4a4c0c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 --2- 172.21.15.155:0/1183157496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 0x7f4a4c0c6090 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0097a0 tx=0x7f4a3c02a180 comp rx=0 tx=0).stop 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 -- 172.21.15.155:0/1183157496 shutdown_connections 2024-04-25T13:16:52.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 --2- 172.21.15.155:0/1183157496 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c0c8870 0x7f4a4c0c6090 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 --2- 172.21.15.155:0/1183157496 >> v2:172.21.15.191:3300/0 conn(0x7f4a4c152f70 0x7f4a4c0c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 -- 172.21.15.155:0/1183157496 >> 172.21.15.155:0/1183157496 conn(0x7f4a4c074d50 msgr2=0x7f4a4c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 -- 172.21.15.155:0/1183157496 shutdown_connections 2024-04-25T13:16:52.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.185+0000 7f4a54719640 1 -- 172.21.15.155:0/1183157496 wait complete. 2024-04-25T13:16:52.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.186+0000 7f4a54719640 1 Processor -- start 2024-04-25T13:16:52.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.186+0000 7f4a54719640 1 -- start start 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a54719640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a4c0c8870 0x7f4a4c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a54719640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c152f70 0x7f4a4c1ee770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a54719640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 0x7f4a4c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a54719640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4c1534d0 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a54719640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4c153350 con 0x7f4a4c0c8870 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a54719640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4a4c073a30 con 0x7f4a4c152f70 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 0x7f4a4c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 0x7f4a4c157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48408/0 (socket says 172.21.15.155:48408) 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 -- 172.21.15.155:0/369583743 learned_addr learned my addr 172.21.15.155:0/369583743 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a524b5640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a4c0c8870 0x7f4a4c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a51cb4640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c152f70 0x7f4a4c1ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 -- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c152f70 msgr2=0x7f4a4c1ee770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c152f70 0x7f4a4c1ee770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 -- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a4c0c8870 msgr2=0x7f4a4c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a4c0c8870 0x7f4a4c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 -- 172.21.15.155:0/369583743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4c15bd20 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.187+0000 7f4a52cb6640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 0x7f4a4c157520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400cab0 tx=0x7f4a4400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.188+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44017070 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.188+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4400ac30 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.188+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a4c15c000 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.188+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44012400 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.188+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a4c157000 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.189+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a4c068e40 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.189+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a4401a070 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.190+0000 7f4a42ffd640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4a3006c8f0 0x7f4a3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.191 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.190+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4a4408bac0 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.190+0000 7f4a524b5640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4a3006c8f0 0x7f4a3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.190+0000 7f4a524b5640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4a3006c8f0 0x7f4a3006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009b40 tx=0x7f4a48009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.194+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a44059560 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.413+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4a4c15c1d0 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.416+0000 7f4a42ffd640 1 -- 172.21.15.155:0/369583743 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174140 (secure 0 0 0) 0x7f4a4405d860 con 0x7f4a4c15c4c0 2024-04-25T13:16:52.418 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:52.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4a3006c8f0 msgr2=0x7f4a3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4a3006c8f0 0x7f4a3006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009b40 tx=0x7f4a48009190 comp rx=0 tx=0).stop 2024-04-25T13:16:52.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 msgr2=0x7f4a4c157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 0x7f4a4c157520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400cab0 tx=0x7f4a4400cf70 comp rx=0 tx=0).stop 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 shutdown_connections 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4c15c4c0 0x7f4a4c157520 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4a3006c8f0 0x7f4a3006edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4a4c152f70 0x7f4a4c1ee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 --2- 172.21.15.155:0/369583743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4a4c0c8870 0x7f4a4c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.418+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 >> 172.21.15.155:0/369583743 conn(0x7f4a4c074d50 msgr2=0x7f4a4c075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.419+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 shutdown_connections 2024-04-25T13:16:52.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.419+0000 7f4a54719640 1 -- 172.21.15.155:0/369583743 wait complete. 2024-04-25T13:16:52.429 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":235379904},{"type":"v1","addr":"172.21.15.155:6833","nonce":235379904}]},"active_addr":"172.21.15.155:6833/235379904","active_change":"2024-04-25T13:16:01.607864+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1157159121}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":207886998}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1527526942}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1678992396}]}]} 2024-04-25T13:16:52.433 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T13:16:52.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T13:16:52.433 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:52.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 Processor -- start 2024-04-25T13:16:52.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 -- start start 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99440c8870 0x7f994415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f994415ca00 0x7f9944073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994415ce90 con 0x7f9944152f70 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f9944158fe0 con 0x7f994415ca00 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.531+0000 7f994a6cb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f99441592c0 con 0x7f99440c8870 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f9948c68640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f994415ca00 0x7f9944073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f99437fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99440c8870 0x7f994415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f9943fff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f9944152f70 0x7f99440c5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:58306/0 (socket says 172.21.15.155:58306) 2024-04-25T13:16:52.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f9943fff640 1 -- 172.21.15.155:0/144991608 learned_addr learned my addr 172.21.15.155:0/144991608 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:52.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f9942ffd640 1 -- 172.21.15.155:0/144991608 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557783190 0 0) 0x7f994415ce90 con 0x7f9944152f70 2024-04-25T13:16:52.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f99437fe640 1 -- 172.21.15.155:0/144991608 >> v2:172.21.15.191:3300/0 conn(0x7f994415ca00 msgr2=0x7f9944073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f99437fe640 1 --2- 172.21.15.155:0/144991608 >> v2:172.21.15.191:3300/0 conn(0x7f994415ca00 0x7f9944073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f99437fe640 1 -- 172.21.15.155:0/144991608 >> v1:172.21.15.191:6789/0 conn(0x7f9944152f70 legacy=0x7f99440c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.532+0000 7f99437fe640 1 -- 172.21.15.155:0/144991608 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99441595a0 con 0x7f99440c8870 2024-04-25T13:16:52.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.533+0000 7f99437fe640 1 --2- 172.21.15.155:0/144991608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99440c8870 0x7f994415c4c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99380097a0 tx=0x7f993802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e9a904f7087cd1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.533+0000 7f9942ffd640 1 -- 172.21.15.155:0/144991608 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938037070 con 0x7f99440c8870 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.533+0000 7f9942ffd640 1 -- 172.21.15.155:0/144991608 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938032440 con 0x7f99440c8870 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.533+0000 7f9942ffd640 1 -- 172.21.15.155:0/144991608 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938032810 con 0x7f99440c8870 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.533+0000 7f994a6cb640 1 -- 172.21.15.155:0/144991608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99440c8870 msgr2=0x7f994415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.533+0000 7f994a6cb640 1 --2- 172.21.15.155:0/144991608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99440c8870 0x7f994415c4c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99380097a0 tx=0x7f993802a180 comp rx=0 tx=0).stop 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.534+0000 7f994a6cb640 1 -- 172.21.15.155:0/144991608 shutdown_connections 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.534+0000 7f994a6cb640 1 --2- 172.21.15.155:0/144991608 >> v2:172.21.15.191:3300/0 conn(0x7f994415ca00 0x7f9944073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.534+0000 7f994a6cb640 1 --2- 172.21.15.155:0/144991608 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f99440c8870 0x7f994415c4c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.534+0000 7f994a6cb640 1 -- 172.21.15.155:0/144991608 >> 172.21.15.155:0/144991608 conn(0x7f9944074d50 msgr2=0x7f9944075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.534+0000 7f994a6cb640 1 -- 172.21.15.155:0/144991608 shutdown_connections 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.534+0000 7f994a6cb640 1 -- 172.21.15.155:0/144991608 wait complete. 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.535+0000 7f994a6cb640 1 Processor -- start 2024-04-25T13:16:52.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.535+0000 7f994a6cb640 1 -- start start 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.535+0000 7f994a6cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 0x7f99440c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9944152f70 0x7f994414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f994415ca00 0x7f99441f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9944153350 con 0x7f99440c8870 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9944159b60 con 0x7f994415ca00 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f99441534d0 con 0x7f9944152f70 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 0x7f99440c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 0x7f99440c95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54470/0 (socket says 172.21.15.155:54470) 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 -- 172.21.15.155:0/262771979 learned_addr learned my addr 172.21.15.155:0/262771979 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9948c68640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f994415ca00 0x7f99441f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f99437fe640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9944152f70 0x7f994414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 -- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9944152f70 msgr2=0x7f994414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9944152f70 0x7f994414fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 -- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f994415ca00 msgr2=0x7f99441f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f994415ca00 0x7f99441f2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 -- 172.21.15.155:0/262771979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99441f2e50 con 0x7f99440c8870 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9948c68640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f994415ca00 0x7f99441f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9943fff640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 0x7f99440c95c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f993400c4d0 tx=0x7f993400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934018070 con 0x7f99440c8870 2024-04-25T13:16:52.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934007500 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99440cb1d0 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934004a20 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.536+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994414f050 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.537+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9944068e40 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.538+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9934004bc0 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.538+0000 7f9940ff9640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f993006c920 0x7f993006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.538+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f993408b260 con 0x7f99440c8870 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.538+0000 7f99437fe640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f993006c920 0x7f993006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.539+0000 7f99437fe640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f993006c920 0x7f993006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9938034000 tx=0x7f993802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.542+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9934059240 con 0x7f99440c8870 2024-04-25T13:16:52.721 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.722+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9944071320 con 0x7f99440c8870 2024-04-25T13:16:52.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.723+0000 7f9940ff9640 1 -- 172.21.15.155:0/262771979 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7f9934058b40 con 0x7f99440c8870 2024-04-25T13:16:52.723 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:52.723 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:52.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f993006c920 msgr2=0x7f993006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f993006c920 0x7f993006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9938034000 tx=0x7f993802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:52.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 msgr2=0x7f99440c95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 0x7f99440c95c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f993400c4d0 tx=0x7f993400c990 comp rx=0 tx=0).stop 2024-04-25T13:16:52.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 shutdown_connections 2024-04-25T13:16:52.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f994415ca00 0x7f99441f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f993006c920 0x7f993006ede0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9944152f70 0x7f994414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 --2- 172.21.15.155:0/262771979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99440c8870 0x7f99440c95c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 >> 172.21.15.155:0/262771979 conn(0x7f9944074d50 msgr2=0x7f9944150680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 shutdown_connections 2024-04-25T13:16:52.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.725+0000 7f994a6cb640 1 -- 172.21.15.155:0/262771979 wait complete. 2024-04-25T13:16:52.736 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T13:16:52.736 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:16:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.833+0000 7f5a846e1640 1 Processor -- start 2024-04-25T13:16:52.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.833+0000 7f5a846e1640 1 -- start start 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a846e1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a846e1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a7c0c9a70 0x7f5a7c0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a846e1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c158e20 con 0x7f5a7c0c9ff0 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a846e1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a7c0c56e0 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a846e1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c1599b0 con 0x7f5a7c152f10 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a81c7c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a7c0c9a70 0x7f5a7c0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.834+0000 7f5a81c7c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a7c0c9a70 0x7f5a7c0cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54480/0 (socket says 172.21.15.155:54480) 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a81c7c640 1 -- 172.21.15.155:0/3948926772 learned_addr learned my addr 172.21.15.155:0/3948926772 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a8247d640 1 --2- 172.21.15.155:0/3948926772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a81c7c640 1 -- 172.21.15.155:0/3948926772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 msgr2=0x7f5a7c0cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a81c7c640 1 --2- 172.21.15.155:0/3948926772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c0cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a81c7c640 1 -- 172.21.15.155:0/3948926772 >> v1:172.21.15.155:6789/0 conn(0x7f5a7c0c9ff0 legacy=0x7f5a7c0c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a81c7c640 1 -- 172.21.15.155:0/3948926772 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c1590c0 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.835+0000 7f5a81c7c640 1 --2- 172.21.15.155:0/3948926772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c0cdf40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098a0 tx=0x7f5a7802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f86501157e6621 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a8147b640 1 -- 172.21.15.155:0/3948926772 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78037070 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a8147b640 1 -- 172.21.15.155:0/3948926772 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78032440 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a8147b640 1 -- 172.21.15.155:0/3948926772 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78032810 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 -- 172.21.15.155:0/3948926772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 msgr2=0x7f5a7c0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 --2- 172.21.15.155:0/3948926772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c0cdf40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a780098a0 tx=0x7f5a7802a290 comp rx=0 tx=0).stop 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 -- 172.21.15.155:0/3948926772 shutdown_connections 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 --2- 172.21.15.155:0/3948926772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c0cdf40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 --2- 172.21.15.155:0/3948926772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 -- 172.21.15.155:0/3948926772 >> 172.21.15.155:0/3948926772 conn(0x7f5a7c06b920 msgr2=0x7f5a7c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 -- 172.21.15.155:0/3948926772 shutdown_connections 2024-04-25T13:16:52.837 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.836+0000 7f5a846e1640 1 -- 172.21.15.155:0/3948926772 wait complete. 2024-04-25T13:16:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.837+0000 7f5a846e1640 1 Processor -- start 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.837+0000 7f5a846e1640 1 -- start start 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a846e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c15b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a846e1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a7c0c9ff0 0x7f5a7c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a846e1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a846e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c159640 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a846e1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c159360 con 0x7f5a7c0c9ff0 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a846e1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c1532f0 con 0x7f5a7c152f10 2024-04-25T13:16:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c15b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c15b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54492/0 (socket says 172.21.15.155:54492) 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 -- 172.21.15.155:0/713016915 learned_addr learned my addr 172.21.15.155:0/713016915 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 -- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 msgr2=0x7f5a7c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 -- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a7c0c9ff0 msgr2=0x7f5a7c14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a81c7c640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a7c0c9ff0 0x7f5a7c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.838+0000 7f5a8247d640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a7c0c9ff0 0x7f5a7c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a8247d640 1 -- 172.21.15.155:0/713016915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c14e560 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a8247d640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c15b1b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00d5f0 tx=0x7f5a6c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0125f0 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c019070 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c14e840 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0129d0 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.839+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c14ee00 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.840+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c068e40 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.840+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a6c012b70 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.841+0000 7f5a72ffd640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a6006c8f0 0x7f5a6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.841+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5a6c08c1c0 con 0x7f5a7c0c9a70 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.841+0000 7f5a81c7c640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a6006c8f0 0x7f5a6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:52.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.841+0000 7f5a81c7c640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a6006c8f0 0x7f5a6006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5a78034000 tx=0x7f5a7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:52.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:52.845+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a6c05a340 con 0x7f5a7c0c9a70 2024-04-25T13:16:53.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.019+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a7c0c9130 con 0x7f5a7c0c9a70 2024-04-25T13:16:53.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.020+0000 7f5a72ffd640 1 -- 172.21.15.155:0/713016915 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18574 (secure 0 0 0) 0x7f5a6c059c40 con 0x7f5a7c0c9a70 2024-04-25T13:16:53.020 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:53.020 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":25,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:16:26.036494+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a6006c8f0 msgr2=0x7f5a6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a6006c8f0 0x7f5a6006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5a78034000 tx=0x7f5a7802e000 comp rx=0 tx=0).stop 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 msgr2=0x7f5a7c15b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c15b1b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00d5f0 tx=0x7f5a6c00dab0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 shutdown_connections 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a6006c8f0 0x7f5a6006edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a7c152f10 0x7f5a7c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a7c0c9ff0 0x7f5a7c14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 --2- 172.21.15.155:0/713016915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a7c0c9a70 0x7f5a7c15b1b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 >> 172.21.15.155:0/713016915 conn(0x7f5a7c06b920 msgr2=0x7f5a7c150270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 shutdown_connections 2024-04-25T13:16:53.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.022+0000 7f5a846e1640 1 -- 172.21.15.155:0/713016915 wait complete. 2024-04-25T13:16:53.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T13:16:53.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T13:16:53.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T13:16:53.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T13:16:53.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T13:16:53.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T13:16:53.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T13:16:53.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T13:16:53.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.201+0000 7f4788368640 1 Processor -- start 2024-04-25T13:16:53.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.201+0000 7f4788368640 1 -- start start 2024-04-25T13:16:53.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f4788368640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 0x7f478006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f4788368640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4780159920 0x7f47800c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f4788368640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478015f6e0 con 0x7f478006ec30 2024-04-25T13:16:53.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f4788368640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f47800c48b0 con 0x7f4780159920 2024-04-25T13:16:53.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f4788368640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f478015f9a0 con 0x7f478006e850 2024-04-25T13:16:53.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f493994f640 1 Processor -- start 2024-04-25T13:16:53.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f493994f640 1 -- start start 2024-04-25T13:16:53.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f1142ef6640 1 Processor -- start 2024-04-25T13:16:53.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f4786104640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 0x7f478006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f4786104640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 0x7f478006f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40676/0 (socket says 172.21.15.155:40676) 2024-04-25T13:16:53.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f4786104640 1 -- 172.21.15.155:0/2935269021 learned_addr learned my addr 172.21.15.155:0/2935269021 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.203+0000 7f1142ef6640 1 -- start start 2024-04-25T13:16:53.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f493994f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49340b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f493994f640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f49340b5450 0x7f49340d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f493994f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49341558c0 con 0x7f49341554e0 2024-04-25T13:16:53.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f493994f640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f49340b4a80 con 0x7f49340b5450 2024-04-25T13:16:53.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f493994f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f49340cb8c0 con 0x7f49340b3c00 2024-04-25T13:16:53.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f4786905640 1 --2- 172.21.15.155:0/2935269021 >> v2:172.21.15.191:3300/0 conn(0x7f4780159920 0x7f47800c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f4932ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f49341554e0 0x7f493415f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36230/0 (socket says 172.21.15.155:36230) 2024-04-25T13:16:53.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f4932ffd640 1 -- 172.21.15.155:0/1519413138 learned_addr learned my addr 172.21.15.155:0/1519413138 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f49337fe640 1 --2- 172.21.15.155:0/1519413138 >> v2:172.21.15.191:3300/0 conn(0x7f49340b5450 0x7f49340d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.204+0000 7f1142ef6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f113c06e850 0x7f113c06f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4931ffb640 1 -- 172.21.15.155:0/1519413138 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984221097 0 0) 0x7f4924001110 con 0x7f49341554e0 2024-04-25T13:16:53.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4931ffb640 1 -- 172.21.15.155:0/1519413138 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f491c003520 con 0x7f49341554e0 2024-04-25T13:16:53.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f48e834b640 1 Processor -- start 2024-04-25T13:16:53.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f48e834b640 1 -- start start 2024-04-25T13:16:53.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4785102640 1 -- 172.21.15.155:0/2935269021 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553067939 0 0) 0x7f478015f6e0 con 0x7f478006ec30 2024-04-25T13:16:53.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4785102640 1 -- 172.21.15.155:0/2935269021 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f476c003520 con 0x7f478006ec30 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f1142ef6640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f113c159920 0x7f113c0c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f1142ef6640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f113c15f6e0 con 0x7f113c06ec30 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f113bfff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f113c06ec30 0x7f113c159210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:38738/0 (socket says 172.21.15.155:38738) 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f113bfff640 1 -- 172.21.15.155:0/2354737371 learned_addr learned my addr 172.21.15.155:0/2354737371 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f1141493640 1 --2- 172.21.15.155:0/2354737371 >> v2:172.21.15.191:3300/0 conn(0x7f113c159920 0x7f113c0c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f113c0c48b0 con 0x7f113c06e850 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f113c15f9a0 con 0x7f113c159920 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f113b7fe640 1 -- 172.21.15.155:0/2354737371 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511284219 0 0) 0x7f113c15f6e0 con 0x7f113c06ec30 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f113b7fe640 1 -- 172.21.15.155:0/2354737371 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1124003520 con 0x7f113c06ec30 2024-04-25T13:16:53.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f1141493640 1 -- 172.21.15.155:0/2354737371 >> v2:172.21.15.155:3300/0 conn(0x7f113c06e850 msgr2=0x7f113c06f4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:53.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f113b7fe640 1 -- 172.21.15.155:0/2354737371 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3800026849 0 0) 0x7f1124003520 con 0x7f113c06ec30 2024-04-25T13:16:53.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4786104640 1 -- 172.21.15.155:0/2935269021 >> v2:172.21.15.191:3300/0 conn(0x7f4780159920 msgr2=0x7f47800c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4786104640 1 --2- 172.21.15.155:0/2935269021 >> v2:172.21.15.191:3300/0 conn(0x7f4780159920 0x7f47800c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4786104640 1 -- 172.21.15.155:0/2935269021 >> v1:172.21.15.191:6789/0 conn(0x7f478006ec30 legacy=0x7f4780159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4786104640 1 -- 172.21.15.155:0/2935269021 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478015fc80 con 0x7f478006e850 2024-04-25T13:16:53.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f4786104640 1 --2- 172.21.15.155:0/2935269021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 0x7f478006f4a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47800c4a30 tx=0x7f477002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27822d0088a8ef78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f49327fc640 1 --2- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49340b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f49337fe640 1 -- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 msgr2=0x7f49340b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f49337fe640 1 --2- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49340b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f4931ffb640 1 -- 172.21.15.155:0/1519413138 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1648725377 0 0) 0x7f491c003520 con 0x7f49341554e0 2024-04-25T13:16:53.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f49337fe640 1 -- 172.21.15.155:0/1519413138 >> v1:172.21.15.155:6789/0 conn(0x7f49341554e0 legacy=0x7f493415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.205+0000 7f49337fe640 1 -- 172.21.15.155:0/1519413138 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49340cbba0 con 0x7f49340b5450 2024-04-25T13:16:53.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f552b59e640 1 Processor -- start 2024-04-25T13:16:53.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f1140c92640 1 --2- 172.21.15.155:0/2354737371 >> v2:172.21.15.155:3300/0 conn(0x7f113c06e850 0x7f113c06f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f48e834b640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f48d80d5080 0x7f48d804b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e834b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f48d80de3a0 0x7f48d80de810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f48d80d5080 0x7f48d804b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f4785102640 1 -- 172.21.15.155:0/2935269021 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770037070 con 0x7f478006e850 2024-04-25T13:16:53.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f4785102640 1 -- 172.21.15.155:0/2935269021 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477002ae50 con 0x7f478006e850 2024-04-25T13:16:53.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f4785102640 1 -- 172.21.15.155:0/2935269021 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47700328a0 con 0x7f478006e850 2024-04-25T13:16:53.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f48d80d5080 0x7f48d804b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54362/0 (socket says 172.21.15.155:54362) 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e834b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d804bc80 con 0x7f48d8045710 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e58e6640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f48d8045710 0x7f48d8045b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36242/0 (socket says 172.21.15.155:36242) 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f48d8007a90 con 0x7f48d80de3a0 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f48d8006e80 con 0x7f48d80d5080 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 -- 172.21.15.155:0/646363914 learned_addr learned my addr 172.21.15.155:0/646363914 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4788368640 1 -- 172.21.15.155:0/2935269021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 msgr2=0x7f478006f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4788368640 1 --2- 172.21.15.155:0/2935269021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 0x7f478006f4a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f47800c4a30 tx=0x7f477002a300 comp rx=0 tx=0).stop 2024-04-25T13:16:53.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f552b59e640 1 -- start start 2024-04-25T13:16:53.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f1141493640 1 --2- 172.21.15.155:0/2354737371 >> v2:172.21.15.155:3300/0 conn(0x7f113c06e850 0x7f113c06f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f1141493640 1 -- 172.21.15.155:0/2354737371 >> v1:172.21.15.191:6789/0 conn(0x7f113c06ec30 legacy=0x7f113c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.206+0000 7f1141493640 1 -- 172.21.15.155:0/2354737371 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c15fc80 con 0x7f113c159920 2024-04-25T13:16:53.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f1141493640 1 --2- 172.21.15.155:0/2354737371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 0x7f113c0c4d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f113c06c410 tx=0x7f113402a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79fa282ec4e16ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.214 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f49906cb640 1 Processor -- start 2024-04-25T13:16:53.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e68e8640 1 --2- 172.21.15.155:0/646363914 >> v2:172.21.15.155:3300/0 conn(0x7f48d80de3a0 0x7f48d80de810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f113b7fe640 1 -- 172.21.15.155:0/2354737371 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130001670 con 0x7f113c159920 2024-04-25T13:16:53.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f113b7fe640 1 -- 172.21.15.155:0/2354737371 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1134007540 con 0x7f113c159920 2024-04-25T13:16:53.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f113b7fe640 1 -- 172.21.15.155:0/2354737371 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134007710 con 0x7f113c159920 2024-04-25T13:16:53.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4788368640 1 -- 172.21.15.155:0/2935269021 shutdown_connections 2024-04-25T13:16:53.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f49337fe640 1 --2- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49340b5450 0x7f49340d08a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49280097a0 tx=0x7f492802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c87689829abbb81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4931ffb640 1 -- 172.21.15.155:0/1519413138 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928037070 con 0x7f49340b5450 2024-04-25T13:16:53.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4931ffb640 1 -- 172.21.15.155:0/1519413138 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492802ac50 con 0x7f49340b5450 2024-04-25T13:16:53.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f4931ffb640 1 -- 172.21.15.155:0/1519413138 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924001840 con 0x7f49340b5450 2024-04-25T13:16:53.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f49906cb640 1 -- start start 2024-04-25T13:16:53.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f552b59e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f552c072400 0x7f552c160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4788368640 1 --2- 172.21.15.155:0/2935269021 >> v2:172.21.15.191:3300/0 conn(0x7f4780159920 0x7f47800c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4788368640 1 --2- 172.21.15.155:0/2935269021 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006e850 0x7f478006f4a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f4788368640 1 -- 172.21.15.155:0/2935269021 >> 172.21.15.155:0/2935269021 conn(0x7f47800c8f00 msgr2=0x7f47800c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f493994f640 1 -- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49340b5450 msgr2=0x7f49340d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f493994f640 1 --2- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49340b5450 0x7f49340d08a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49280097a0 tx=0x7f492802a1c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f4788368640 1 -- 172.21.15.155:0/2935269021 shutdown_connections 2024-04-25T13:16:53.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f552b59e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f552c15fbf0 0x7f552c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f552b59e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f552c162800 con 0x7f552c163270 2024-04-25T13:16:53.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f552b59e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f552c0c8120 con 0x7f552c072400 2024-04-25T13:16:53.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f552b59e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f552c1636b0 con 0x7f552c15fbf0 2024-04-25T13:16:53.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f4788368640 1 -- 172.21.15.155:0/2935269021 wait complete. 2024-04-25T13:16:53.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f493994f640 1 -- 172.21.15.155:0/1519413138 shutdown_connections 2024-04-25T13:16:53.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f493994f640 1 --2- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49340b5450 0x7f49340d08a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f493994f640 1 --2- 172.21.15.155:0/1519413138 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49340b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f493994f640 1 -- 172.21.15.155:0/1519413138 >> 172.21.15.155:0/1519413138 conn(0x7f4934074d50 msgr2=0x7f4934075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f5d50322640 1 Processor -- start 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f5d50322640 1 -- start start 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f49906cb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49881595d0 0x7f49880c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.208+0000 7f49906cb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f49880c38e0 0x7f49880cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f49906cb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49881603c0 con 0x7f49880c8df0 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f49906cb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f498815fe90 con 0x7f49881595d0 2024-04-25T13:16:53.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f49906cb640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f49880c7790 con 0x7f49880c38e0 2024-04-25T13:16:53.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 -- 172.21.15.155:0/646363914 >> v2:172.21.15.155:3300/0 conn(0x7f48d80de3a0 msgr2=0x7f48d80de810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 --2- 172.21.15.155:0/646363914 >> v2:172.21.15.155:3300/0 conn(0x7f48d80de3a0 0x7f48d80de810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 -- 172.21.15.155:0/646363914 >> v1:172.21.15.155:6789/0 conn(0x7f48d8045710 legacy=0x7f48d8045b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.207+0000 7f48e60e7640 1 -- 172.21.15.155:0/646363914 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d8007160 con 0x7f48d80d5080 2024-04-25T13:16:53.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f493994f640 1 -- 172.21.15.155:0/1519413138 shutdown_connections 2024-04-25T13:16:53.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f5529d9b640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f552c163270 0x7f552c0727e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:38748/0 (socket says 172.21.15.155:38748) 2024-04-25T13:16:53.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f5529d9b640 1 -- 172.21.15.155:0/3758908667 learned_addr learned my addr 172.21.15.155:0/3758908667 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f493994f640 1 -- 172.21.15.155:0/1519413138 wait complete. 2024-04-25T13:16:53.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f48e60e7640 1 --2- 172.21.15.155:0/646363914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d80d5080 0x7f48d804b740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007e00 tx=0x7f48d002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d658a0d750036cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f498e467640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49881595d0 0x7f49880c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f498e467640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49881595d0 0x7f49880c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54536/0 (socket says 172.21.15.155:54536) 2024-04-25T13:16:53.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f498e467640 1 -- 172.21.15.155:0/949312105 learned_addr learned my addr 172.21.15.155:0/949312105 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848181277 0 0) 0x7f552c162800 con 0x7f552c163270 2024-04-25T13:16:53.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5514003520 con 0x7f552c163270 2024-04-25T13:16:53.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f498dc66640 1 --2- 172.21.15.155:0/949312105 >> v2:172.21.15.191:3300/0 conn(0x7f49880c38e0 0x7f49880cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f48e50e5640 1 -- 172.21.15.155:0/646363914 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0037070 con 0x7f48d80d5080 2024-04-25T13:16:53.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f5d50322640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5d481510b0 0x7f5d48157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f48e50e5640 1 -- 172.21.15.155:0/646363914 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d002ae50 con 0x7f48d80d5080 2024-04-25T13:16:53.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f48e50e5640 1 -- 172.21.15.155:0/646363914 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0032860 con 0x7f48d80d5080 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 msgr2=0x7f113c0c4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f1142ef6640 1 --2- 172.21.15.155:0/2354737371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 0x7f113c0c4d40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f113c06c410 tx=0x7f113402a6a0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 shutdown_connections 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f1142ef6640 1 --2- 172.21.15.155:0/2354737371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 0x7f113c0c4d40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f1142ef6640 1 --2- 172.21.15.155:0/2354737371 >> v2:172.21.15.155:3300/0 conn(0x7f113c06e850 0x7f113c06f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 >> 172.21.15.155:0/2354737371 conn(0x7f113c0c8f00 msgr2=0x7f113c0c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.209+0000 7f5d50322640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d48151490 0x7f5d480c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 <== mon.1 v1:172.21.15.191:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1472804574 0 0) 0x7f5514003520 con 0x7f552c163270 2024-04-25T13:16:53.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d50322640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4806f230 con 0x7f5d48071120 2024-04-25T13:16:53.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d50322640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4806ee70 con 0x7f5d481510b0 2024-04-25T13:16:53.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d50322640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5d480c7140 con 0x7f5d48151490 2024-04-25T13:16:53.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4d8bd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d48151490 0x7f5d480c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4d8bd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d48151490 0x7f5d480c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40696/0 (socket says 172.21.15.155:40696) 2024-04-25T13:16:53.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4d8bd640 1 -- 172.21.15.155:0/4159147957 learned_addr learned my addr 172.21.15.155:0/4159147957 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f552c15fbf0 msgr2=0x7f552c158c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:53.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f498dc66640 1 -- 172.21.15.155:0/949312105 >> v2:172.21.15.155:3300/0 conn(0x7f49881595d0 msgr2=0x7f49880c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f498dc66640 1 --2- 172.21.15.155:0/949312105 >> v2:172.21.15.155:3300/0 conn(0x7f49881595d0 0x7f49880c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f498dc66640 1 -- 172.21.15.155:0/949312105 >> v1:172.21.15.191:6789/0 conn(0x7f49880c8df0 legacy=0x7f4988162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f498dc66640 1 -- 172.21.15.155:0/949312105 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49881600e0 con 0x7f49880c38e0 2024-04-25T13:16:53.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f552c15fbf0 0x7f552c158c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 >> v2:172.21.15.155:3300/0 conn(0x7f552c072400 msgr2=0x7f552c160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4e0be640 1 --2- 172.21.15.155:0/4159147957 >> v2:172.21.15.155:3300/0 conn(0x7f5d481510b0 0x7f5d48157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 --2- 172.21.15.155:0/3758908667 >> v2:172.21.15.155:3300/0 conn(0x7f552c072400 0x7f552c160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 --> v1:172.21.15.191:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c070320 con 0x7f552c163270 2024-04-25T13:16:53.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 <== mon.1 v1:172.21.15.191:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f5520001670 con 0x7f552c163270 2024-04-25T13:16:53.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 >> v1:172.21.15.191:6789/0 conn(0x7f552c163270 legacy=0x7f552c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f35c4b5d640 1 Processor -- start 2024-04-25T13:16:53.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4e0be640 1 -- 172.21.15.155:0/4159147957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d48151490 msgr2=0x7f5d480c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5514004800 0x7f5514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4e0be640 1 --2- 172.21.15.155:0/4159147957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d48151490 0x7f5d480c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f5d4e0be640 1 -- 172.21.15.155:0/4159147957 >> v1:172.21.15.155:6789/0 conn(0x7f5d48071120 legacy=0x7f5d4815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f493994f640 1 Processor -- start 2024-04-25T13:16:53.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d80d5080 msgr2=0x7f48d804b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f48e834b640 1 --2- 172.21.15.155:0/646363914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d80d5080 0x7f48d804b740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007e00 tx=0x7f48d002a300 comp rx=0 tx=0).stop 2024-04-25T13:16:53.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5514005210 0x7f551400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f552c1636b0 con 0x7f55140039b0 2024-04-25T13:16:53.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f551400c120 con 0x7f5514005210 2024-04-25T13:16:53.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f551400c320 con 0x7f5514004800 2024-04-25T13:16:53.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552a59c640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 shutdown_connections 2024-04-25T13:16:53.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 shutdown_connections 2024-04-25T13:16:53.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f493994f640 1 -- start start 2024-04-25T13:16:53.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552a59c640 1 -- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5514004800 msgr2=0x7f5514004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552a59c640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5514004800 0x7f5514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f48e834b640 1 --2- 172.21.15.155:0/646363914 >> v2:172.21.15.155:3300/0 conn(0x7f48d80de3a0 0x7f48d80de810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f48e834b640 1 --2- 172.21.15.155:0/646363914 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d80d5080 0x7f48d804b740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 >> 172.21.15.155:0/646363914 conn(0x7f48d80505c0 msgr2=0x7f48d80509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552a59c640 1 -- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5514005210 msgr2=0x7f551400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f4788368640 1 Processor -- start 2024-04-25T13:16:53.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f4788368640 1 -- start start 2024-04-25T13:16:53.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552ad9d640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5514005210 0x7f551400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.210+0000 7f35c4b5d640 1 -- start start 2024-04-25T13:16:53.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552a59c640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5514005210 0x7f551400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f552a59c640 1 -- 172.21.15.155:0/3758908667 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c070320 con 0x7f55140039b0 2024-04-25T13:16:53.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f1142ef6640 1 -- 172.21.15.155:0/2354737371 wait complete. 2024-04-25T13:16:53.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35c4b5d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006e850 0x7f35c006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35c4b5d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f35c006ec30 0x7f35c0159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 shutdown_connections 2024-04-25T13:16:53.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35c4b5d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c015f6e0 con 0x7f35c00c4310 2024-04-25T13:16:53.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35c4b5d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f35c00c48b0 con 0x7f35c006ec30 2024-04-25T13:16:53.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35c4b5d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f35c015f9a0 con 0x7f35c006e850 2024-04-25T13:16:53.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f48e834b640 1 -- 172.21.15.155:0/646363914 wait complete. 2024-04-25T13:16:53.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f5d4e0be640 1 -- 172.21.15.155:0/4159147957 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d480c7420 con 0x7f5d481510b0 2024-04-25T13:16:53.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f493994f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49341f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35bed9d640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f35c00c4310 0x7f35c00c4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:38772/0 (socket says 172.21.15.155:38772) 2024-04-25T13:16:53.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35bed9d640 1 -- 172.21.15.155:0/4081975864 learned_addr learned my addr 172.21.15.155:0/4081975864 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f552ad9d640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5514005210 0x7f551400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:53.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f493994f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49340b5450 0x7f49340ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35bdd9b640 1 --2- 172.21.15.155:0/4081975864 >> v2:172.21.15.191:3300/0 conn(0x7f35c006ec30 0x7f35c0159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f498dc66640 1 --2- 172.21.15.155:0/949312105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49880c38e0 0x7f49880cc890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f498815d000 tx=0x7f498002a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6bf4afc96ea1fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f498d465640 1 -- 172.21.15.155:0/949312105 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980007540 con 0x7f49880c38e0 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f498d465640 1 -- 172.21.15.155:0/949312105 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49800076e0 con 0x7f49880c38e0 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f498d465640 1 -- 172.21.15.155:0/949312105 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980007ab0 con 0x7f49880c38e0 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f493994f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49341554e0 0x7f4934147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f493994f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49340b4710 con 0x7f49340b5450 2024-04-25T13:16:53.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f493994f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49340b4430 con 0x7f49341554e0 2024-04-25T13:16:53.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f493994f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f49340b3580 con 0x7f49340b3c00 2024-04-25T13:16:53.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f35be59c640 1 --2- 172.21.15.155:0/4081975864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006e850 0x7f35c006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4932ffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49341f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4932ffd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49341f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40722/0 (socket says 172.21.15.155:40722) 2024-04-25T13:16:53.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f49327fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49340b5450 0x7f49340ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4932ffd640 1 -- 172.21.15.155:0/2474383387 learned_addr learned my addr 172.21.15.155:0/2474383387 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f49337fe640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49341554e0 0x7f4934147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f5d4e0be640 1 --2- 172.21.15.155:0/4159147957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d481510b0 0x7f5d48157a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097a0 tx=0x7f5d4402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914c67e99944e694 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35bd59a640 1 -- 172.21.15.155:0/4081975864 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258244096 0 0) 0x7f35c015f6e0 con 0x7f35c00c4310 2024-04-25T13:16:53.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4932ffd640 1 -- 172.21.15.155:0/2474383387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49341554e0 msgr2=0x7f4934147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4932ffd640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49341554e0 0x7f4934147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4932ffd640 1 -- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49340b5450 msgr2=0x7f49340ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4932ffd640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49340b5450 0x7f49340ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4932ffd640 1 -- 172.21.15.155:0/2474383387 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49340c7f80 con 0x7f49340b3c00 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f552a59c640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f551c006fd0 tx=0x7f5514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca05da9d64b7d58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c037070 con 0x7f55140039b0 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c02aa70 con 0x7f55140039b0 2024-04-25T13:16:53.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f552959a640 1 -- 172.21.15.155:0/3758908667 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551c009460 con 0x7f55140039b0 2024-04-25T13:16:53.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f1142ef6640 1 Processor -- start 2024-04-25T13:16:53.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f1142ef6640 1 -- start start 2024-04-25T13:16:53.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f5d4d0bc640 1 -- 172.21.15.155:0/4159147957 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44037070 con 0x7f5d481510b0 2024-04-25T13:16:53.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35bd59a640 1 -- 172.21.15.155:0/4081975864 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a8003520 con 0x7f35c00c4310 2024-04-25T13:16:53.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35be59c640 1 -- 172.21.15.155:0/4081975864 >> v2:172.21.15.191:3300/0 conn(0x7f35c006ec30 msgr2=0x7f35c0159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35be59c640 1 --2- 172.21.15.155:0/4081975864 >> v2:172.21.15.191:3300/0 conn(0x7f35c006ec30 0x7f35c0159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35be59c640 1 -- 172.21.15.155:0/4081975864 >> v1:172.21.15.191:6789/0 conn(0x7f35c00c4310 legacy=0x7f35c00c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35be59c640 1 -- 172.21.15.155:0/4081975864 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c015fc80 con 0x7f35c006e850 2024-04-25T13:16:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f35bdd9b640 1 --2- 172.21.15.155:0/4081975864 >> v2:172.21.15.191:3300/0 conn(0x7f35c006ec30 0x7f35c0159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49906cb640 1 -- 172.21.15.155:0/949312105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49880c38e0 msgr2=0x7f49880cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49906cb640 1 --2- 172.21.15.155:0/949312105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49880c38e0 0x7f49880cc890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f498815d000 tx=0x7f498002a620 comp rx=0 tx=0).stop 2024-04-25T13:16:53.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4932ffd640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49341f5900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f492400c750 tx=0x7f492400cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49327fc640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49340b5450 0x7f49340ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f4788368640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f478006e850 0x7f47801579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f4788368640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006ec30 0x7f478015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924017070 con 0x7f49340b3c00 2024-04-25T13:16:53.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4924005ae0 con 0x7f49340b3c00 2024-04-25T13:16:53.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924007070 con 0x7f49340b3c00 2024-04-25T13:16:53.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f5d4d0bc640 1 -- 172.21.15.155:0/4159147957 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44032440 con 0x7f5d481510b0 2024-04-25T13:16:53.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f5d4d0bc640 1 -- 172.21.15.155:0/4159147957 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44032850 con 0x7f5d481510b0 2024-04-25T13:16:53.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49340c8260 con 0x7f49340b3c00 2024-04-25T13:16:53.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49906cb640 1 -- 172.21.15.155:0/949312105 shutdown_connections 2024-04-25T13:16:53.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49906cb640 1 --2- 172.21.15.155:0/949312105 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49880c38e0 0x7f49880cc890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49906cb640 1 --2- 172.21.15.155:0/949312105 >> v2:172.21.15.155:3300/0 conn(0x7f49881595d0 0x7f49880c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f49906cb640 1 -- 172.21.15.155:0/949312105 >> 172.21.15.155:0/949312105 conn(0x7f4988074d50 msgr2=0x7f4988075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f4788368640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4780159920 0x7f47801f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f49340c8820 con 0x7f49340b3c00 2024-04-25T13:16:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f48e834b640 1 Processor -- start 2024-04-25T13:16:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 -- 172.21.15.155:0/4159147957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d481510b0 msgr2=0x7f5d48157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 --2- 172.21.15.155:0/4159147957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d481510b0 0x7f5d48157a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097a0 tx=0x7f5d4402a250 comp rx=0 tx=0).stop 2024-04-25T13:16:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f48e834b640 1 -- start start 2024-04-25T13:16:53.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f4788368640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f478015f3d0 con 0x7f478006e850 2024-04-25T13:16:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f552b59e640 1 -- 172.21.15.155:0/3758908667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55140039b0 msgr2=0x7f5514003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f552b59e640 1 --2- 172.21.15.155:0/3758908667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f551c006fd0 tx=0x7f5514005830 comp rx=0 tx=0).stop 2024-04-25T13:16:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 -- 172.21.15.155:0/4159147957 shutdown_connections 2024-04-25T13:16:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 --2- 172.21.15.155:0/4159147957 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d48151490 0x7f5d480c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 --2- 172.21.15.155:0/4159147957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d481510b0 0x7f5d48157a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 -- 172.21.15.155:0/4159147957 >> 172.21.15.155:0/4159147957 conn(0x7f5d480c8f00 msgr2=0x7f5d480c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f4788368640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4780160240 con 0x7f4780159920 2024-04-25T13:16:53.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 -- 172.21.15.155:0/4159147957 shutdown_connections 2024-04-25T13:16:53.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f1142ef6640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f113c06e850 0x7f113c151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.211+0000 7f4788368640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f478006f9e0 con 0x7f478006ec30 2024-04-25T13:16:53.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4785903640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006ec30 0x7f478015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f1142ef6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113c06ec30 0x7f113c153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4785903640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006ec30 0x7f478015c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40704/0 (socket says 172.21.15.155:40704) 2024-04-25T13:16:53.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f552ad9d640 1 -- 172.21.15.155:0/3758908667 reap_dead start 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4785903640 1 -- 172.21.15.155:0/3883021562 learned_addr learned my addr 172.21.15.155:0/3883021562 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4786104640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f478006e850 0x7f47801579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.212+0000 7f4786905640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4780159920 0x7f47801f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4785903640 1 -- 172.21.15.155:0/3883021562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4780159920 msgr2=0x7f47801f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4785903640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4780159920 0x7f47801f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4785903640 1 -- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f478006e850 msgr2=0x7f47801579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4785903640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f478006e850 0x7f47801579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4785903640 1 -- 172.21.15.155:0/3883021562 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478015cbd0 con 0x7f478006ec30 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.213+0000 7f4786104640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f478006e850 0x7f47801579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:53.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f4785903640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006ec30 0x7f478015c290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f477800c830 tx=0x7f477800ccf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778003b70 con 0x7f478006ec30 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778003d10 con 0x7f478006ec30 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477800aa90 con 0x7f478006ec30 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47801f85a0 con 0x7f478006ec30 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47801f8b60 con 0x7f478006ec30 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f552b59e640 1 -- 172.21.15.155:0/3758908667 shutdown_connections 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f552b59e640 1 -- 172.21.15.155:0/3758908667 >> 172.21.15.155:0/3758908667 conn(0x7f552c0cd640 msgr2=0x7f552c0cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f35be59c640 1 --2- 172.21.15.155:0/4081975864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006e850 0x7f35c006f4a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097a0 tx=0x7f35b002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f069d1a5a88d28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.214+0000 7f5d50322640 1 -- 172.21.15.155:0/4159147957 wait complete. 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49341f5e40 con 0x7f49340b3c00 2024-04-25T13:16:53.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f552b59e640 1 -- 172.21.15.155:0/3758908667 shutdown_connections 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f113bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113c06ec30 0x7f113c153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f1142ef6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 0x7f113c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f1142ef6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f113c15f3d0 con 0x7f113c06ec30 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f1140c92640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f113c06e850 0x7f113c151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f1140c92640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f113c06e850 0x7f113c151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40728/0 (socket says 172.21.15.155:40728) 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f1140c92640 1 -- 172.21.15.155:0/1309757239 learned_addr learned my addr 172.21.15.155:0/1309757239 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f35bd59a640 1 -- 172.21.15.155:0/4081975864 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0037070 con 0x7f35c006e850 2024-04-25T13:16:53.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f35bd59a640 1 -- 172.21.15.155:0/4081975864 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0032440 con 0x7f35c006e850 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f49906cb640 1 -- 172.21.15.155:0/949312105 shutdown_connections 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f49906cb640 1 -- 172.21.15.155:0/949312105 wait complete. 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f48e834b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d8045710 0x7f48d8175ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.215+0000 7f48e834b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d80d5080 0x7f48d8178ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e834b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48d80de3a0 0x7f48d80e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d8045710 0x7f48d8175ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d8045710 0x7f48d8175ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54432/0 (socket says 172.21.15.155:54432) 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 -- 172.21.15.155:0/1535850547 learned_addr learned my addr 172.21.15.155:0/1535850547 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f48d80d5460 con 0x7f48d80d5080 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8007720 con 0x7f48d8045710 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f48d804cb40 con 0x7f48d80de3a0 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e68e8640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48d80de3a0 0x7f48d80e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f5d50322640 1 Processor -- start 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f35c4b5d640 1 -- 172.21.15.155:0/4081975864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006e850 msgr2=0x7f35c006f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.258 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f35c4b5d640 1 --2- 172.21.15.155:0/4081975864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006e850 0x7f35c006f4a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097a0 tx=0x7f35b002a1c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f1141493640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 0x7f113c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 -- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48d80de3a0 msgr2=0x7f48d80e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f48d80de3a0 0x7f48d80e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f35c4b5d640 1 -- 172.21.15.155:0/4081975864 shutdown_connections 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f35c4b5d640 1 --2- 172.21.15.155:0/4081975864 >> v2:172.21.15.191:3300/0 conn(0x7f35c006ec30 0x7f35c0159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f35c4b5d640 1 --2- 172.21.15.155:0/4081975864 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006e850 0x7f35c006f4a0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35b00097a0 tx=0x7f35b002a1c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.259 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f35c4b5d640 1 -- 172.21.15.155:0/4081975864 >> 172.21.15.155:0/4081975864 conn(0x7f35c00c8f00 msgr2=0x7f35c00c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 -- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d80d5080 msgr2=0x7f48d8178ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48d80d5080 0x7f48d8178ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f48e60e7640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d8176000 con 0x7f48d8045710 2024-04-25T13:16:53.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4768001030 con 0x7f478006ec30 2024-04-25T13:16:53.260 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f35c4b5d640 1 -- 172.21.15.155:0/4081975864 shutdown_connections 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f477800ac30 con 0x7f478006ec30 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f113c160240 con 0x7f113c159920 2024-04-25T13:16:53.261 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f113c06f9e0 con 0x7f113c06e850 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f4776ffd640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f476406c9c0 0x7f476406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f477808be20 con 0x7f478006ec30 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f5d50322640 1 -- start start 2024-04-25T13:16:53.262 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f49906cb640 1 Processor -- start 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f4776ffd640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7f4764076130 0x7f4764078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 --> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4778009eb0 con 0x7f4764076130 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f477808e480 con 0x7f478006ec30 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f49906cb640 1 -- start start 2024-04-25T13:16:53.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f5d50322640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d48071120 0x7f5d480c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f4786905640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7f4764076130 0x7f4764078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f5d50322640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d481510b0 0x7f5d481f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f113bfff640 1 -- 172.21.15.155:0/1309757239 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f113c06e850 msgr2=0x7f113c151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.264 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f113bfff640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f113c06e850 0x7f113c151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f113bfff640 1 -- 172.21.15.155:0/1309757239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 msgr2=0x7f113c1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f113bfff640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f113c159920 0x7f113c1542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f113bfff640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c1f5670 con 0x7f113c06ec30 2024-04-25T13:16:53.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d4e0be640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d48071120 0x7f5d480c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d4e0be640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d48071120 0x7f5d480c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54458/0 (socket says 172.21.15.155:54458) 2024-04-25T13:16:53.265 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d4e0be640 1 -- 172.21.15.155:0/82754009 learned_addr learned my addr 172.21.15.155:0/82754009 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f492401a070 con 0x7f49340b3c00 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f491bfff640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f492006c9c0 0x7f492006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f492408b230 con 0x7f49340b3c00 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f491bfff640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f4920076130 0x7f4920078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 --> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f492400ae50 con 0x7f4920076130 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4924092050 con 0x7f49340b3c00 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f4786905640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7f4764076130 0x7f4764078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.216+0000 7f552b59e640 1 -- 172.21.15.155:0/3758908667 wait complete. 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f552b59e640 1 Processor -- start 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f552b59e640 1 -- start start 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552b59e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55140039b0 0x7f552c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552b59e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f552c15d3a0 0x7f552c1fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552b59e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f552c15d7e0 0x7f552c154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552a59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55140039b0 0x7f552c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.267 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552a59c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55140039b0 0x7f552c1577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40748/0 (socket says 172.21.15.155:40748) 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f113bfff640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113c06ec30 0x7f113c153da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1130000f60 tx=0x7f113000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130017070 con 0x7f113c06ec30 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1130005ad0 con 0x7f113c06ec30 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130007070 con 0x7f113c06ec30 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113c1f5950 con 0x7f113c06ec30 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113c1f5f10 con 0x7f113c06ec30 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d4d8bd640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d481510b0 0x7f5d481f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d50322640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d48151490 0x7f5d481f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d480c7cc0 con 0x7f5d48151490 2024-04-25T13:16:53.268 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5d480c79e0 con 0x7f5d48071120 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5d480c7fa0 con 0x7f5d481510b0 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f5d4e8bf640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d48151490 0x7f5d481f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d4e0be640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d481510b0 msgr2=0x7f5d481f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d4e0be640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5d481510b0 0x7f5d481f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d4e0be640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d48151490 msgr2=0x7f5d481f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d4e0be640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d48151490 0x7f5d481f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d4e0be640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d48147400 con 0x7f5d48071120 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d4e0be640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d48071120 0x7f5d480c29a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d440098c0 tx=0x7f5d440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44037040 con 0x7f5d48071120 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d440306f0 con 0x7f5d48071120 2024-04-25T13:16:53.269 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f35c4b5d640 1 -- 172.21.15.155:0/4081975864 wait complete. 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f49906cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49880c38e0 0x7f4988152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f49906cb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49880c8df0 0x7f4988152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f49906cb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49881595d0 0x7f49880cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f498e467640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49880c38e0 0x7f4988152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f498e467640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49880c38e0 0x7f4988152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54592/0 (socket says 172.21.15.155:54592) 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f498e467640 1 -- 172.21.15.155:0/2971463900 learned_addr learned my addr 172.21.15.155:0/2971463900 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4988159b30 con 0x7f49880c38e0 2024-04-25T13:16:53.270 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f48e60e7640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d8045710 0x7f48d8175ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48d0000c00 tx=0x7f48d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0041070 con 0x7f48d8045710 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d003c670 con 0x7f48d8045710 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.217+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0037040 con 0x7f48d8045710 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d80c6a20 con 0x7f48d8045710 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.218+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d80c6480 con 0x7f48d8045710 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f49337fe640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f4920076130 0x7f4920078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f49881599b0 con 0x7f49881595d0 2024-04-25T13:16:53.271 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f498ec68640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49881595d0 0x7f49880cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552a59c640 1 -- 172.21.15.155:0/875779424 learned_addr learned my addr 172.21.15.155:0/875779424 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f113c1f6110 con 0x7f113c06ec30 2024-04-25T13:16:53.272 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f552ad9d640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f552c15d7e0 0x7f552c154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f49337fe640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f4920076130 0x7f4920078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44030ac0 con 0x7f5d48071120 2024-04-25T13:16:53.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.219+0000 7f498dc66640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49880c8df0 0x7f4988152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f49881634b0 con 0x7f49880c8df0 2024-04-25T13:16:53.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d481476e0 con 0x7f5d48071120 2024-04-25T13:16:53.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d48147ca0 con 0x7f5d48071120 2024-04-25T13:16:53.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f5529d9b640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f552c15d3a0 0x7f552c1fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498e467640 1 -- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49880c8df0 msgr2=0x7f4988152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.274 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d48068e40 con 0x7f5d48071120 2024-04-25T13:16:53.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498e467640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49880c8df0 0x7f4988152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498e467640 1 -- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49881595d0 msgr2=0x7f49880cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498e467640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49881595d0 0x7f49880cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498e467640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4988162180 con 0x7f49880c38e0 2024-04-25T13:16:53.275 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498ec68640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f49881595d0 0x7f49880cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f498e467640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49880c38e0 0x7f4988152740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f498400e870 tx=0x7f498400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f4786104640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f476406c9c0 0x7f476406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.276 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f49327fc640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f492006c9c0 0x7f492006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f552c162d50 con 0x7f552c15d7e0 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f552c162a70 con 0x7f552c15d3a0 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.220+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f552c160060 con 0x7f55140039b0 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f552ad9d640 1 -- 172.21.15.155:0/875779424 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55140039b0 msgr2=0x7f552c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f552ad9d640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55140039b0 0x7f552c1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f552ad9d640 1 -- 172.21.15.155:0/875779424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f552c15d3a0 msgr2=0x7f552c1fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f552ad9d640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f552c15d3a0 0x7f552c1fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f552ad9d640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c0c8f90 con 0x7f552c15d7e0 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f552ad9d640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f552c15d7e0 0x7f552c154670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c8770 tx=0x7f552400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524008040 con 0x7f552c15d7e0 2024-04-25T13:16:53.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== osd.1 v2:172.21.15.155:6816/3446698651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4778009eb0 con 0x7f4764076130 2024-04-25T13:16:53.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524017070 con 0x7f552c15d7e0 2024-04-25T13:16:53.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c0c9230 con 0x7f552c15d7e0 2024-04-25T13:16:53.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c200820 con 0x7f552c15d7e0 2024-04-25T13:16:53.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f35c4b5d640 1 Processor -- start 2024-04-25T13:16:53.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== osd.0 v2:172.21.15.155:6800/2134228032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f492400ae50 con 0x7f4920076130 2024-04-25T13:16:53.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984017070 con 0x7f49880c38e0 2024-04-25T13:16:53.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498400c8e0 con 0x7f49880c38e0 2024-04-25T13:16:53.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498400ccd0 con 0x7f49880c38e0 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f113001a070 con 0x7f113c06ec30 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f11397fa640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f112806c9c0 0x7f112806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f113008ba90 con 0x7f113c06ec30 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f11397fa640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f1128076140 0x7f1128078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48d0044070 con 0x7f48d8045710 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.221+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f48d80057d0 con 0x7f48d8045710 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f48d6ffd640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f48c406c8f0 0x7f48c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f48d00ac6a0 con 0x7f48d8045710 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f48d6ffd640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7f48c4075fe0 0x7f48c4078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48d0036e90 con 0x7f48c4075fe0 2024-04-25T13:16:53.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1130014ec0 con 0x7f1128076140 2024-04-25T13:16:53.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f113008be80 con 0x7f113c06ec30 2024-04-25T13:16:53.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48d00b3050 con 0x7f48d8045710 2024-04-25T13:16:53.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.222+0000 7f48e68e8640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7f48c4075fe0 0x7f48c4078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552400ab90 con 0x7f552c15d7e0 2024-04-25T13:16:53.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f1141493640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f1128076140 0x7f1128078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f1140c92640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f112806c9c0 0x7f112806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f552c2011c0 con 0x7f552c15d7e0 2024-04-25T13:16:53.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f49327fc640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f492006c9c0 0x7f492006ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f492c009fd0 tx=0x7f492c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f35c4b5d640 1 -- start start 2024-04-25T13:16:53.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f48e68e8640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7f48c4075fe0 0x7f48c4078420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f4786104640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f476406c9c0 0x7f476406ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4770034000 tx=0x7f477002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d44044020 con 0x7f5d48071120 2024-04-25T13:16:53.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4988161620 con 0x7f49880c38e0 2024-04-25T13:16:53.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.223+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49880cd5e0 con 0x7f49880c38e0 2024-04-25T13:16:53.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f48e58e6640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f48c406c8f0 0x7f48c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== osd.7 v2:172.21.15.191:6816/3056123415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48d0036e90 con 0x7f48c4075fe0 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f1141493640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f1128076140 0x7f1128078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f1140c92640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f112806c9c0 0x7f112806ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f112c006fd0 tx=0x7f112c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f5d3effd640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5d2c06c940 0x7f5d2c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5d440ac500 con 0x7f5d48071120 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f5d3effd640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d44032440 con 0x7f5d2c0760b0 2024-04-25T13:16:53.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d440ac8b0 con 0x7f5d48071120 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35c4b5d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006ec30 0x7f35c01ef4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35c4b5d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35c00c4310 0x7f35c01fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35c4b5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c01efd40 0x7f35c01f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35c4b5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f35c015f3d0 con 0x7f35c01efd40 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35c4b5d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0160240 con 0x7f35c00c4310 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35c4b5d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f35c006f9e0 con 0x7f35c006ec30 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35bed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c01efd40 0x7f35c01f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35bed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c01efd40 0x7f35c01f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54614/0 (socket says 172.21.15.155:54614) 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35bed9d640 1 -- 172.21.15.155:0/3432560605 learned_addr learned my addr 172.21.15.155:0/3432560605 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35bdd9b640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35c00c4310 0x7f35c01fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.224+0000 7f35be59c640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006ec30 0x7f35c01ef4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f5d4e8bf640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f48e58e6640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f48c406c8f0 0x7f48c406edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48dc000f60 tx=0x7f48dc007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f5d4e8bf640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 msgr2=0x7f5d2c0784f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f5d4e8bf640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 msgr2=0x7f5d2c0784f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f5d4e8bf640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f5d4e8bf640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f552400ad30 con 0x7f552c15d7e0 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f35be59c640 1 -- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35c00c4310 msgr2=0x7f35c01fe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f35be59c640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35c00c4310 0x7f35c01fe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f35be59c640 1 -- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c01efd40 msgr2=0x7f35c01f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f35be59c640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c01efd40 0x7f35c01f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f35be59c640 1 -- 172.21.15.155:0/3432560605 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c01f01f0 con 0x7f35c006ec30 2024-04-25T13:16:53.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4988161b40 con 0x7f49880c38e0 2024-04-25T13:16:53.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f551affd640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f550c06c8f0 0x7f550c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f35be59c640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006ec30 0x7f35c01ef4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35c00c4a30 tx=0x7f35b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f552408c830 con 0x7f552c15d7e0 2024-04-25T13:16:53.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.225+0000 7f5d4d8bd640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5d2c06c940 0x7f5d2c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f551affd640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f550c075fe0 0x7f550c078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f550c078af0 con 0x7f550c075fe0 2024-04-25T13:16:53.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f552408cc20 con 0x7f552c15d7e0 2024-04-25T13:16:53.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f552a59c640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f550c06c8f0 0x7f550c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f5529d9b640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f550c075fe0 0x7f550c078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0041070 con 0x7f35c006ec30 2024-04-25T13:16:53.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0030870 con 0x7f35c006ec30 2024-04-25T13:16:53.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0030c60 con 0x7f35c006ec30 2024-04-25T13:16:53.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c01f04d0 con 0x7f35c006ec30 2024-04-25T13:16:53.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c01eecd0 con 0x7f35c006ec30 2024-04-25T13:16:53.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.226+0000 7f5529d9b640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f550c075fe0 0x7f550c078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.227+0000 7f552a59c640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f550c06c8f0 0x7f550c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f551c004700 tx=0x7f551c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.227+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f498401a070 con 0x7f49880c38e0 2024-04-25T13:16:53.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.227+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== osd.3 v2:172.21.15.155:6802/1299092023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1130014ec0 con 0x7f1128076140 2024-04-25T13:16:53.293 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.227+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35c01f07b0 con 0x7f35c006ec30 2024-04-25T13:16:53.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.227+0000 7f497effd640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f496c06c9c0 0x7f496c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.227+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f498408c4c0 con 0x7f49880c38e0 2024-04-25T13:16:53.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f498dc66640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f496c06c9c0 0x7f496c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== osd.2 v2:172.21.15.155:6824/3777344599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f550c078af0 con 0x7f550c075fe0 2024-04-25T13:16:53.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f497effd640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f496c076140 0x7f496c078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4984026e50 con 0x7f496c076140 2024-04-25T13:16:53.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f498408c8b0 con 0x7f49880c38e0 2024-04-25T13:16:53.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f5d4d8bd640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5d2c06c940 0x7f5d2c06ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5d480c3790 tx=0x7f5d3800f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f498ec68640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f496c076140 0x7f496c078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.228+0000 7f498dc66640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f496c06c9c0 0x7f496c06ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4980034000 tx=0x7f498002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.229+0000 7f498ec68640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f496c076140 0x7f496c078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.229+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35b003d420 con 0x7f35c006ec30 2024-04-25T13:16:53.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.229+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== osd.6 v2:172.21.15.191:6824/1440480290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4984026e50 con 0x7f496c076140 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.229+0000 7f35aeffd640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35a006c940 0x7f35a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.230+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f35b00ac670 con 0x7f35c006ec30 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.230+0000 7f35aeffd640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7f35a00760b0 0x7f35a00784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.230+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 --> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35b0008eb0 con 0x7f35a00760b0 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.230+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f35b00acb50 con 0x7f35c006ec30 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.231+0000 7f35bdd9b640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35a006c940 0x7f35a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.231+0000 7f35bed9d640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7f35a00760b0 0x7f35a00784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.231+0000 7f35bdd9b640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35a006c940 0x7f35a006ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009bd0 tx=0x7f35b800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.232+0000 7f35bed9d640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7f35a00760b0 0x7f35a00784f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.232+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== osd.5 v2:172.21.15.191:6800/2170630618 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35b0008eb0 con 0x7f35a00760b0 2024-04-25T13:16:53.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.247+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 --> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35c01f07b0 con 0x7f35a00760b0 2024-04-25T13:16:53.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.247+0000 7f35aeffd640 1 -- 172.21.15.155:0/3432560605 <== osd.5 v2:172.21.15.191:6800/2170630618 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35c01f07b0 con 0x7f35a00760b0 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.247+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7f35a00760b0 msgr2=0x7f35a00784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.247+0000 7f35c4b5d640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7f35a00760b0 0x7f35a00784f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35a006c940 msgr2=0x7f35a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35a006c940 0x7f35a006ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009bd0 tx=0x7f35b800d040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006ec30 msgr2=0x7f35c01ef4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 --2- 172.21.15.155:0/3432560605 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35c006ec30 0x7f35c01ef4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35c00c4a30 tx=0x7f35b00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35bed9d640 1 -- 172.21.15.155:0/3432560605 reap_dead start 2024-04-25T13:16:53.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 shutdown_connections 2024-04-25T13:16:53.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 >> 172.21.15.155:0/3432560605 conn(0x7f35c00c8f00 msgr2=0x7f35c0158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 shutdown_connections 2024-04-25T13:16:53.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.248+0000 7f35c4b5d640 1 -- 172.21.15.155:0/3432560605 wait complete. 2024-04-25T13:16:53.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.254+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 --> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4934068e40 con 0x7f4920076130 2024-04-25T13:16:53.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.254+0000 7f491bfff640 1 -- 172.21.15.155:0/2474383387 <== osd.0 v2:172.21.15.155:6800/2134228032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4934068e40 con 0x7f4920076130 2024-04-25T13:16:53.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f4920076130 msgr2=0x7f4920078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f4920076130 0x7f4920078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f492006c9c0 msgr2=0x7f492006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f492006c9c0 0x7f492006ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f492c009fd0 tx=0x7f492c00b040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 msgr2=0x7f49341f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 --2- 172.21.15.155:0/2474383387 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f49340b3c00 0x7f49341f5900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f492400c750 tx=0x7f492400cc10 comp rx=0 tx=0).stop 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f49337fe640 1 -- 172.21.15.155:0/2474383387 reap_dead start 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 shutdown_connections 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 >> 172.21.15.155:0/2474383387 conn(0x7f4934074d50 msgr2=0x7f4934072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 shutdown_connections 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.255+0000 7f493994f640 1 -- 172.21.15.155:0/2474383387 wait complete. 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.256+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 --> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f48d80057d0 con 0x7f48c4075fe0 2024-04-25T13:16:53.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.256+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 --> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4768002dd0 con 0x7f4764076130 2024-04-25T13:16:53.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.257+0000 7f4776ffd640 1 -- 172.21.15.155:0/3883021562 <== osd.1 v2:172.21.15.155:6816/3446698651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4768002dd0 con 0x7f4764076130 2024-04-25T13:16:53.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.257+0000 7f48d6ffd640 1 -- 172.21.15.155:0/1535850547 <== osd.7 v2:172.21.15.191:6816/3056123415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f48d80057d0 con 0x7f48c4075fe0 2024-04-25T13:16:53.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.257+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7f4764076130 msgr2=0x7f4764078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.304 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.257+0000 7f4788368640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7f4764076130 0x7f4764078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7f48c4075fe0 msgr2=0x7f48c4078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7f48c4075fe0 0x7f48c4078420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f476406c9c0 msgr2=0x7f476406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f476406c9c0 0x7f476406ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4770034000 tx=0x7f477002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006ec30 msgr2=0x7f478015c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 --2- 172.21.15.155:0/3883021562 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f478006ec30 0x7f478015c290 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f477800c830 tx=0x7f477800ccf0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.305 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4786905640 1 -- 172.21.15.155:0/3883021562 reap_dead start 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 shutdown_connections 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 >> 172.21.15.155:0/3883021562 conn(0x7f47800c8f00 msgr2=0x7f47800c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f48c406c8f0 msgr2=0x7f48c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f48c406c8f0 0x7f48c406edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48dc000f60 tx=0x7f48dc007a00 comp rx=0 tx=0).stop 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d8045710 msgr2=0x7f48d8175ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 --2- 172.21.15.155:0/1535850547 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f48d8045710 0x7f48d8175ac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48d0000c00 tx=0x7f48d00046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.306 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e68e8640 1 -- 172.21.15.155:0/1535850547 reap_dead start 2024-04-25T13:16:53.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 shutdown_connections 2024-04-25T13:16:53.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f4788368640 1 -- 172.21.15.155:0/3883021562 wait complete. 2024-04-25T13:16:53.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 shutdown_connections 2024-04-25T13:16:53.307 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 >> 172.21.15.155:0/1535850547 conn(0x7f48d80505c0 msgr2=0x7f48d8004af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 shutdown_connections 2024-04-25T13:16:53.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.258+0000 7f48e834b640 1 -- 172.21.15.155:0/1535850547 wait complete. 2024-04-25T13:16:53.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.259+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 --> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4988161b40 con 0x7f496c076140 2024-04-25T13:16:53.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.259+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 --> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f552c0c7d30 con 0x7f550c075fe0 2024-04-25T13:16:53.308 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.259+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 --> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f113c068e40 con 0x7f1128076140 2024-04-25T13:16:53.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.260+0000 7f497effd640 1 -- 172.21.15.155:0/2971463900 <== osd.6 v2:172.21.15.191:6824/1440480290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4988161b40 con 0x7f496c076140 2024-04-25T13:16:53.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.260+0000 7f551affd640 1 -- 172.21.15.155:0/875779424 <== osd.2 v2:172.21.15.155:6824/3777344599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f552c0c7d30 con 0x7f550c075fe0 2024-04-25T13:16:53.309 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.260+0000 7f11397fa640 1 -- 172.21.15.155:0/1309757239 <== osd.3 v2:172.21.15.155:6802/1299092023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f113c068e40 con 0x7f1128076140 2024-04-25T13:16:53.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.260+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f496c076140 msgr2=0x7f496c078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.260+0000 7f49906cb640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f496c076140 0x7f496c078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f550c075fe0 msgr2=0x7f550c078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f550c075fe0 0x7f550c078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.311 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f496c06c9c0 msgr2=0x7f496c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f49906cb640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f496c06c9c0 0x7f496c06ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4980034000 tx=0x7f498002f000 comp rx=0 tx=0).stop 2024-04-25T13:16:53.312 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:16:53.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f550c06c8f0 msgr2=0x7f550c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f550c06c8f0 0x7f550c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f551c004700 tx=0x7f551c02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:53.312 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f552c15d7e0 msgr2=0x7f552c154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 --2- 172.21.15.155:0/875779424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f552c15d7e0 0x7f552c154670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f552c0c8770 tx=0x7f552400cd80 comp rx=0 tx=0).stop 2024-04-25T13:16:53.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49880c38e0 msgr2=0x7f4988152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f49906cb640 1 --2- 172.21.15.155:0/2971463900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49880c38e0 0x7f4988152740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f498400e870 tx=0x7f498400ed30 comp rx=0 tx=0).stop 2024-04-25T13:16:53.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552ad9d640 1 -- 172.21.15.155:0/875779424 reap_dead start 2024-04-25T13:16:53.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f498ec68640 1 -- 172.21.15.155:0/2971463900 reap_dead start 2024-04-25T13:16:53.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 shutdown_connections 2024-04-25T13:16:53.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 >> 172.21.15.155:0/2971463900 conn(0x7f4988074d50 msgr2=0x7f49880c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 shutdown_connections 2024-04-25T13:16:53.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 >> 172.21.15.155:0/875779424 conn(0x7f552c0cd640 msgr2=0x7f552c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f1128076140 msgr2=0x7f1128078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f1142ef6640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f1128076140 0x7f1128078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.261+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 shutdown_connections 2024-04-25T13:16:53.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 shutdown_connections 2024-04-25T13:16:53.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f49906cb640 1 -- 172.21.15.155:0/2971463900 wait complete. 2024-04-25T13:16:53.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f552b59e640 1 -- 172.21.15.155:0/875779424 wait complete. 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f112806c9c0 msgr2=0x7f112806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1142ef6640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f112806c9c0 0x7f112806ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f112c006fd0 tx=0x7f112c008040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113c06ec30 msgr2=0x7f113c153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1142ef6640 1 --2- 172.21.15.155:0/1309757239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f113c06ec30 0x7f113c153da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1130000f60 tx=0x7f113000cb60 comp rx=0 tx=0).stop 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1141493640 1 -- 172.21.15.155:0/1309757239 reap_dead start 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 shutdown_connections 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.262+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 >> 172.21.15.155:0/1309757239 conn(0x7f113c0c8f00 msgr2=0x7f113c0c4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.263+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 shutdown_connections 2024-04-25T13:16:53.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.263+0000 7f1142ef6640 1 -- 172.21.15.155:0/1309757239 wait complete. 2024-04-25T13:16:53.318 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:16:53.319 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.319 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:16:53.320 INFO:teuthology.orchestra.run.smithi155.stdout:55834574860 2024-04-25T13:16:53.320 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:16:53.321 INFO:teuthology.orchestra.run.smithi155.stdout:55834574858 2024-04-25T13:16:53.321 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:16:53.322 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.322 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:16:53.323 INFO:teuthology.orchestra.run.smithi155.stdout:55834574860 2024-04-25T13:16:53.323 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:16:53.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.426+0000 7f5d4e8bf640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.427+0000 7f5d4e8bf640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.427+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== osd.4 v2:172.21.15.191:6802/2288973653 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d44032440 con 0x7f5d2c0760b0 2024-04-25T13:16:53.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.457+0000 7f5d50322640 1 -- 172.21.15.155:0/82754009 --> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d480723d0 con 0x7f5d2c0760b0 2024-04-25T13:16:53.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.458+0000 7f5d3effd640 1 -- 172.21.15.155:0/82754009 <== osd.4 v2:172.21.15.191:6802/2288973653 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d480723d0 con 0x7f5d2c0760b0 2024-04-25T13:16:53.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 msgr2=0x7f5d2c0784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f5d2c0760b0 0x7f5d2c0784f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5d2c06c940 msgr2=0x7f5d2c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5d2c06c940 0x7f5d2c06ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5d480c3790 tx=0x7f5d3800f040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d48071120 msgr2=0x7f5d480c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 --2- 172.21.15.155:0/82754009 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5d48071120 0x7f5d480c29a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d440098c0 tx=0x7f5d440046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d4e8bf640 1 -- 172.21.15.155:0/82754009 reap_dead start 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 shutdown_connections 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 >> 172.21.15.155:0/82754009 conn(0x7f5d480c8f00 msgr2=0x7f5d4806e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 shutdown_connections 2024-04-25T13:16:53.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.459+0000 7f5d3cff9640 1 -- 172.21.15.155:0/82754009 wait complete. 2024-04-25T13:16:53.480 INFO:teuthology.orchestra.run.smithi155.stdout:55834574860 2024-04-25T13:16:53.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:16:53.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.505+0000 7f0cd8afd640 1 Processor -- start 2024-04-25T13:16:53.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.505+0000 7f0cd8afd640 1 -- start start 2024-04-25T13:16:53.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.506+0000 7f0cd8afd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cd406bb90 0x7f0cd4073a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.506+0000 7f0cd8afd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0cd406bf70 0x7f0cd4073f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.506+0000 7f0cd259c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cd406bb90 0x7f0cd4073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.506+0000 7f0cd259c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0cd406bb90 0x7f0cd4073a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54624/0 (socket says 172.21.15.155:54624) 2024-04-25T13:16:53.507 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.506+0000 7f0cd259c640 1 -- 172.21.15.155:0/3240693080 learned_addr learned my addr 172.21.15.155:0/3240693080 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd41629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd4074550 con 0x7f0cd406bb90 2024-04-25T13:16:53.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f0cd415f530 con 0x7f0cd406bf70 2024-04-25T13:16:53.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd415f810 con 0x7f0cd40c95a0 2024-04-25T13:16:53.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd2d9d640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd41629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.508 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd1d9b640 1 --2- 172.21.15.155:0/3240693080 >> v2:172.21.15.191:3300/0 conn(0x7f0cd406bf70 0x7f0cd4073f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd1d9b640 1 -- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 msgr2=0x7f0cd41629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd1d9b640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd41629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd1d9b640 1 -- 172.21.15.155:0/3240693080 >> v2:172.21.15.155:3300/0 conn(0x7f0cd406bb90 msgr2=0x7f0cd4073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd1d9b640 1 --2- 172.21.15.155:0/3240693080 >> v2:172.21.15.155:3300/0 conn(0x7f0cd406bb90 0x7f0cd4073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.507+0000 7f0cd1d9b640 1 -- 172.21.15.155:0/3240693080 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd415faf0 con 0x7f0cd406bf70 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.509+0000 7f0cd1d9b640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd4073f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40cf7c0 tx=0x7f0cc802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d5874e6bf645f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.509+0000 7f0cd159a640 1 -- 172.21.15.155:0/3240693080 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8037070 con 0x7f0cd406bf70 2024-04-25T13:16:53.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.509+0000 7f0cd159a640 1 -- 172.21.15.155:0/3240693080 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc8032440 con 0x7f0cd406bf70 2024-04-25T13:16:53.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd159a640 1 -- 172.21.15.155:0/3240693080 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8032850 con 0x7f0cd406bf70 2024-04-25T13:16:53.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 msgr2=0x7f0cd4073f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.510 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd4073f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40cf7c0 tx=0x7f0cc802a1e0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 shutdown_connections 2024-04-25T13:16:53.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd41629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/3240693080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd4073f70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/3240693080 >> v2:172.21.15.155:3300/0 conn(0x7f0cd406bb90 0x7f0cd4073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.510+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 >> 172.21.15.155:0/3240693080 conn(0x7f0cd4074d50 msgr2=0x7f0cd4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.511+0000 7f1be717d640 1 Processor -- start 2024-04-25T13:16:53.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.511+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 shutdown_connections 2024-04-25T13:16:53.512 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.511+0000 7f0cd8afd640 1 -- 172.21.15.155:0/3240693080 wait complete. 2024-04-25T13:16:53.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.512+0000 7f1be717d640 1 -- start start 2024-04-25T13:16:53.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1be717d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be00b3c00 0x7f1be00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1be717d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be01558c0 con 0x7f1be01554e0 2024-04-25T13:16:53.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1be717d640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1be00cb8c0 con 0x7f1be00b5450 2024-04-25T13:16:53.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1be717d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00b4a80 con 0x7f1be00b3c00 2024-04-25T13:16:53.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f0cd8afd640 1 Processor -- start 2024-04-25T13:16:53.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1be4f19640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f1be01554e0 0x7f1be015f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36246/0 (socket says 172.21.15.155:36246) 2024-04-25T13:16:53.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f0cd8afd640 1 -- start start 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1be571a640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f1be00b5450 0x7f1be00d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:38788/0 (socket says 172.21.15.155:38788) 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f1be571a640 1 -- 172.21.15.155:0/3604037568 learned_addr learned my addr 172.21.15.155:0/3604037568 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.513+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be00b3c00 0x7f1be00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2301813483 0 0) 0x7f1be00cb8c0 con 0x7f1be00b5450 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd0003520 con 0x7f1be00b5450 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd8afd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd406bb90 0x7f0cd4161bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd8afd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd8afd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd8afd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41630b0 con 0x7f0cd406bb90 2024-04-25T13:16:53.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd8afd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4162f30 con 0x7f0cd406bf70 2024-04-25T13:16:53.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd8afd640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd4163230 con 0x7f0cd40c95a0 2024-04-25T13:16:53.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f0cd259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd406bb90 0x7f0cd4161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.514+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271802709 0 0) 0x7f1bcc001110 con 0x7f1be01554e0 2024-04-25T13:16:53.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd406bb90 0x7f0cd4161bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54628/0 (socket says 172.21.15.155:54628) 2024-04-25T13:16:53.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd259c640 1 -- 172.21.15.155:0/1774236606 learned_addr learned my addr 172.21.15.155:0/1774236606 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1be00cb8c0 con 0x7f1be01554e0 2024-04-25T13:16:53.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd2d9d640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd1d9b640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2150390199 0 0) 0x7f1be00cb8c0 con 0x7f1be01554e0 2024-04-25T13:16:53.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be00b3c00 msgr2=0x7f1be00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be00b3c00 0x7f1be00b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 >> v1:172.21.15.191:6789/0 conn(0x7f1be00b5450 legacy=0x7f1be00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd2d9d640 1 -- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 msgr2=0x7f0cd415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00cbba0 con 0x7f1be01554e0 2024-04-25T13:16:53.519 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd2d9d640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f1bcc001840 con 0x7f1be01554e0 2024-04-25T13:16:53.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd2d9d640 1 -- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd406bb90 msgr2=0x7f0cd4161bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 >> v1:172.21.15.155:6789/0 conn(0x7f1be01554e0 legacy=0x7f1be015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd2d9d640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd406bb90 0x7f0cd4161bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.515+0000 7f0cd2d9d640 1 -- 172.21.15.155:0/1774236606 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd4159390 con 0x7f0cd40c95a0 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1bdf7fe640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1bd0003b70 0x7f1bd0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1bdf7fe640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1bd0004800 0x7f1bd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1bdf7fe640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bd00051c0 0x7f1bd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00b4a80 con 0x7f1bd00051c0 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd000bf60 con 0x7f1bd0004800 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd000c160 con 0x7f1bd0003b70 2024-04-25T13:16:53.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1bd0003b70 0x7f1bd0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f0cd2d9d640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd415aa80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00eba0 tx=0x7f0ccc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f1be571a640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bd00051c0 0x7f1bd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f1bdffff640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1bd0004800 0x7f1bd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f1be4f19640 1 -- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1bd0004800 msgr2=0x7f1bd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1bd0004800 0x7f1bd0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f1be4f19640 1 -- 172.21.15.155:0/3604037568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bd00051c0 msgr2=0x7f1bd000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bd00051c0 0x7f1bd000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f1be4f19640 1 -- 172.21.15.155:0/3604037568 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00cb8c0 con 0x7f1bd0003b70 2024-04-25T13:16:53.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f1be571a640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bd00051c0 0x7f1bd000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f20fbd08640 1 Processor -- start 2024-04-25T13:16:53.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.516+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc018020 con 0x7f0cd40c95a0 2024-04-25T13:16:53.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.517+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00cd20 con 0x7f0cd40c95a0 2024-04-25T13:16:53.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0146c0 con 0x7f0cd40c95a0 2024-04-25T13:16:53.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd4159630 con 0x7f0cd40c95a0 2024-04-25T13:16:53.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd4159a60 con 0x7f0cd40c95a0 2024-04-25T13:16:53.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1bd0003b70 0x7f1bd0003f70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00c240 tx=0x7f1bd0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48001230d97f30b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc007cf0 con 0x7f1bd0003b70 2024-04-25T13:16:53.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc005a30 con 0x7f1bd0003b70 2024-04-25T13:16:53.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f1bdf7fe640 1 -- 172.21.15.155:0/3604037568 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc007070 con 0x7f1bd0003b70 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.518+0000 7f20fbd08640 1 -- start start 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f20fbd08640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f41570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f20fbd08640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20f406f870 0x7f20f40c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f20fbd08640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f40c46b0 con 0x7f20f406ec30 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f20fbd08640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f20f40c4990 con 0x7f20f406f870 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f20fbd08640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f20f40c4c70 con 0x7f20f406e850 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.519+0000 7f20f92a3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20f406f870 0x7f20f40c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f20f92a3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20f406f870 0x7f20f40c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54652/0 (socket says 172.21.15.155:54652) 2024-04-25T13:16:53.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be717d640 1 -- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1bd0003b70 msgr2=0x7f1bd0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be717d640 1 --2- 172.21.15.155:0/3604037568 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1bd0003b70 0x7f1bd0003f70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00c240 tx=0x7f1bd0005830 comp rx=0 tx=0).stop 2024-04-25T13:16:53.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f20f92a3640 1 -- 172.21.15.155:0/1233807081 learned_addr learned my addr 172.21.15.155:0/1233807081 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f20f92a3640 1 -- 172.21.15.155:0/1233807081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 msgr2=0x7f20f41570f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:53.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f20f92a3640 1 --2- 172.21.15.155:0/1233807081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f41570f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f20f92a3640 1 -- 172.21.15.155:0/1233807081 >> v1:172.21.15.191:6789/0 conn(0x7f20f406ec30 legacy=0x7f20f4150f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:53.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f20f92a3640 1 -- 172.21.15.155:0/1233807081 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f40c4f50 con 0x7f20f406f870 2024-04-25T13:16:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be571a640 1 -- 172.21.15.155:0/3604037568 reap_dead start 2024-04-25T13:16:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be717d640 1 -- 172.21.15.155:0/3604037568 shutdown_connections 2024-04-25T13:16:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be717d640 1 -- 172.21.15.155:0/3604037568 >> 172.21.15.155:0/3604037568 conn(0x7f1be0074d50 msgr2=0x7f1be0075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be717d640 1 -- 172.21.15.155:0/3604037568 shutdown_connections 2024-04-25T13:16:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ccc005d10 con 0x7f0cd40c95a0 2024-04-25T13:16:53.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd4068e40 con 0x7f0cd40c95a0 2024-04-25T13:16:53.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.520+0000 7f1be717d640 1 -- 172.21.15.155:0/3604037568 wait complete. 2024-04-25T13:16:53.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.521+0000 7f0cc2ffd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0cb406c9c0 0x7f0cb406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.521+0000 7f5a5d6ef640 1 Processor -- start 2024-04-25T13:16:53.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.521+0000 7f5a5d6ef640 1 -- start start 2024-04-25T13:16:53.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.521+0000 7f0cd259c640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0cb406c9c0 0x7f0cb406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f20f92a3640 1 --2- 172.21.15.155:0/1233807081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f40c5a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009e50 tx=0x7f20ec02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c4b465132d84d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f1be717d640 1 Processor -- start 2024-04-25T13:16:53.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f1be717d640 1 -- start start 2024-04-25T13:16:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f20f8aa2640 1 -- 172.21.15.155:0/1233807081 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec036070 con 0x7f20f406f870 2024-04-25T13:16:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f20f8aa2640 1 -- 172.21.15.155:0/1233807081 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec031600 con 0x7f20f406f870 2024-04-25T13:16:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f20f8aa2640 1 -- 172.21.15.155:0/1233807081 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0319d0 con 0x7f20f406f870 2024-04-25T13:16:53.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f96927f7640 1 Processor -- start 2024-04-25T13:16:53.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0ccc08cb20 con 0x7f0cd40c95a0 2024-04-25T13:16:53.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a5d6ef640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a58152fd0 0x7f5a58071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a5d6ef640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a58074410 0x7f5a5815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a5d6ef640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a580c7bd0 con 0x7f5a580c6e00 2024-04-25T13:16:53.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a5d6ef640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f5a580c86a0 con 0x7f5a58152fd0 2024-04-25T13:16:53.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a5d6ef640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5a580c8980 con 0x7f5a58074410 2024-04-25T13:16:53.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f0cd259c640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0cb406c9c0 0x7f0cb406ee80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4006a90 tx=0x7f0cc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a577fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5a580c6e00 0x7f5a58073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36250/0 (socket says 172.21.15.155:36250) 2024-04-25T13:16:53.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a4e7fc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5a58074410 0x7f5a5815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a577fe640 1 -- 172.21.15.155:0/3817377080 learned_addr learned my addr 172.21.15.155:0/3817377080 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a56ffd640 1 --2- 172.21.15.155:0/3817377080 >> v2:172.21.15.155:3300/0 conn(0x7f5a58152fd0 0x7f5a58071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f20fbd08640 1 -- 172.21.15.155:0/1233807081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 msgr2=0x7f20f40c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f20fbd08640 1 --2- 172.21.15.155:0/1233807081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f40c5a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009e50 tx=0x7f20ec02a780 comp rx=0 tx=0).stop 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f20fbd08640 1 -- 172.21.15.155:0/1233807081 shutdown_connections 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f20fbd08640 1 --2- 172.21.15.155:0/1233807081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f40c5a30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f20fbd08640 1 --2- 172.21.15.155:0/1233807081 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f41570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f20fbd08640 1 -- 172.21.15.155:0/1233807081 >> 172.21.15.155:0/1233807081 conn(0x7f20f40c8f00 msgr2=0x7f20f40c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a4e7fc640 1 -- 172.21.15.155:0/3817377080 >> v2:172.21.15.155:3300/0 conn(0x7f5a58152fd0 msgr2=0x7f5a58071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a4e7fc640 1 --2- 172.21.15.155:0/3817377080 >> v2:172.21.15.155:3300/0 conn(0x7f5a58152fd0 0x7f5a58071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a4e7fc640 1 -- 172.21.15.155:0/3817377080 >> v1:172.21.15.155:6789/0 conn(0x7f5a580c6e00 legacy=0x7f5a58073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a567fc640 1 -- 172.21.15.155:0/3817377080 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613832890 0 0) 0x7f5a580c7bd0 con 0x7f5a580c6e00 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f5a4e7fc640 1 -- 172.21.15.155:0/3817377080 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5815c3d0 con 0x7f5a58074410 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.522+0000 7f96927f7640 1 -- start start 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f96927f7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f968c151840 0x7f968c157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f96927f7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c0c26f0 0x7f968c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f96927f7640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c0c8cb0 con 0x7f968c06d560 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f96927f7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f968c0c38e0 con 0x7f968c151840 2024-04-25T13:16:53.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f96927f7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f968c0c8f50 con 0x7f968c0c26f0 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f1be717d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1be014ec30 0x7f1be00cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f1be717d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 0x7f1be00cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f1be717d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be0147d50 0x7f1be01481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f1be717d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00b4710 con 0x7f1be014ec30 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f1be717d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f1be00b4430 con 0x7f1be014f010 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.523+0000 7f1be717d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00b3580 con 0x7f1be0147d50 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 0x7f1be00cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 0x7f1be00cf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54516/0 (socket says 172.21.15.155:54516) 2024-04-25T13:16:53.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1bdffff640 1 -- 172.21.15.155:0/3087145491 learned_addr learned my addr 172.21.15.155:0/3087145491 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1be571a640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be0147d50 0x7f1be01481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f20fbd08640 1 -- 172.21.15.155:0/1233807081 shutdown_connections 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f9690d94640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f968c06d560 0x7f968c0c7f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:38804/0 (socket says 172.21.15.155:38804) 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f9690d94640 1 -- 172.21.15.155:0/65329961 learned_addr learned my addr 172.21.15.155:0/65329961 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968b7fe640 1 --2- 172.21.15.155:0/65329961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c0c26f0 0x7f968c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968bfff640 1 --2- 172.21.15.155:0/65329961 >> v2:172.21.15.155:3300/0 conn(0x7f968c151840 0x7f968c157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968affd640 1 -- 172.21.15.155:0/65329961 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290237406 0 0) 0x7f968c0c8cb0 con 0x7f968c06d560 2024-04-25T13:16:53.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968affd640 1 -- 172.21.15.155:0/65329961 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9678003520 con 0x7f968c06d560 2024-04-25T13:16:53.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f609a86d640 1 Processor -- start 2024-04-25T13:16:53.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f5a4e7fc640 1 --2- 172.21.15.155:0/3817377080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a58074410 0x7f5a5815ceb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a580c7da0 tx=0x7f5a4002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180b440d3714eeb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f20fbd08640 1 -- 172.21.15.155:0/1233807081 wait complete. 2024-04-25T13:16:53.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f5a567fc640 1 -- 172.21.15.155:0/3817377080 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40037070 con 0x7f5a58074410 2024-04-25T13:16:53.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f5a567fc640 1 -- 172.21.15.155:0/3817377080 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a40032440 con 0x7f5a58074410 2024-04-25T13:16:53.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f5a567fc640 1 -- 172.21.15.155:0/3817377080 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4002ae60 con 0x7f5a58074410 2024-04-25T13:16:53.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f609a86d640 1 -- start start 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968b7fe640 1 -- 172.21.15.155:0/65329961 >> v2:172.21.15.155:3300/0 conn(0x7f968c151840 msgr2=0x7f968c157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1be014ec30 0x7f1be00cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1bdffff640 1 -- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be0147d50 msgr2=0x7f1be01481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1bdffff640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be0147d50 0x7f1be01481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f1bdffff640 1 -- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1be014ec30 msgr2=0x7f1be00cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1bdffff640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1be014ec30 0x7f1be00cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1bdffff640 1 -- 172.21.15.155:0/3087145491 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be015d620 con 0x7f1be014f010 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1be014ec30 0x7f1be00cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:16:53.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1bdffff640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 0x7f1be00cf560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40107f0 tx=0x7f1bd4010bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400f040 con 0x7f1be014f010 2024-04-25T13:16:53.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1be717d640 1 -- 172.21.15.155:0/3087145491 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be01e4540 con 0x7f1be014f010 2024-04-25T13:16:53.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1be717d640 1 -- 172.21.15.155:0/3087145491 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be015e8b0 con 0x7f1be014f010 2024-04-25T13:16:53.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.525+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd400e960 con 0x7f1be014f010 2024-04-25T13:16:53.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f20fbd08640 1 Processor -- start 2024-04-25T13:16:53.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968b7fe640 1 --2- 172.21.15.155:0/65329961 >> v2:172.21.15.155:3300/0 conn(0x7f968c151840 0x7f968c157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968b7fe640 1 -- 172.21.15.155:0/65329961 >> v1:172.21.15.191:6789/0 conn(0x7f968c06d560 legacy=0x7f968c0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968b7fe640 1 -- 172.21.15.155:0/65329961 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c0c9210 con 0x7f968c0c26f0 2024-04-25T13:16:53.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.524+0000 7f968bfff640 1 --2- 172.21.15.155:0/65329961 >> v2:172.21.15.155:3300/0 conn(0x7f968c151840 0x7f968c157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:53.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/3817377080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a58074410 msgr2=0x7f5a5815ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/3817377080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a58074410 0x7f5a5815ceb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a580c7da0 tx=0x7f5a4002a110 comp rx=0 tx=0).stop 2024-04-25T13:16:53.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f609a86d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 0x7f60940cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f968b7fe640 1 --2- 172.21.15.155:0/65329961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c0c26f0 0x7f968c06d020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f967c00ba50 tx=0x7f967c02c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b3d821af975c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/3817377080 shutdown_connections 2024-04-25T13:16:53.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/3817377080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a58074410 0x7f5a5815ceb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/3817377080 >> v2:172.21.15.155:3300/0 conn(0x7f5a58152fd0 0x7f5a58071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/3817377080 >> 172.21.15.155:0/3817377080 conn(0x7f5a580c8f00 msgr2=0x7f5a580c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f609986b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 0x7f60940cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f41f4863640 1 Processor -- start 2024-04-25T13:16:53.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400ed30 con 0x7f1be014f010 2024-04-25T13:16:53.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f20fbd08640 1 -- start start 2024-04-25T13:16:53.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f968affd640 1 -- 172.21.15.155:0/65329961 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c033730 con 0x7f968c0c26f0 2024-04-25T13:16:53.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f968affd640 1 -- 172.21.15.155:0/65329961 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c0338d0 con 0x7f968c0c26f0 2024-04-25T13:16:53.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f968affd640 1 -- 172.21.15.155:0/65329961 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c033730 con 0x7f968c0c26f0 2024-04-25T13:16:53.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f41f4863640 1 -- start start 2024-04-25T13:16:53.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/3817377080 shutdown_connections 2024-04-25T13:16:53.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/3817377080 wait complete. 2024-04-25T13:16:53.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f5a5d6ef640 1 Processor -- start 2024-04-25T13:16:53.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f1be717d640 1 -- 172.21.15.155:0/3087145491 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be0068e40 con 0x7f1be014f010 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fbd08640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fbd08640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f406ec30 0x7f20f4158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fbd08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f4158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20f92a3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f406ec30 0x7f20f4158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fa2a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f4158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fa2a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f4158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54710/0 (socket says 172.21.15.155:54710) 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fa2a5640 1 -- 172.21.15.155:0/927469262 learned_addr learned my addr 172.21.15.155:0/927469262 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4151610 con 0x7f20f406f870 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f20f40c5510 con 0x7f20f406ec30 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f20f4151790 con 0x7f20f406e850 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f20f9aa4640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f20fa2a5640 1 -- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 msgr2=0x7f20f414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f20fa2a5640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f20fa2a5640 1 -- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f406ec30 msgr2=0x7f20f4158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f20fa2a5640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f406ec30 0x7f20f4158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f20fa2a5640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f41f1c90 con 0x7f20f406f870 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f20fa2a5640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f4158ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b3c0 tx=0x7f20f000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f96927f7640 1 -- 172.21.15.155:0/65329961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c0c26f0 msgr2=0x7f968c06d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f96927f7640 1 --2- 172.21.15.155:0/65329961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c0c26f0 0x7f968c06d020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f967c00ba50 tx=0x7f967c02c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f96927f7640 1 -- 172.21.15.155:0/65329961 shutdown_connections 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f96927f7640 1 --2- 172.21.15.155:0/65329961 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c0c26f0 0x7f968c06d020 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f967c00ba50 tx=0x7f967c02c8c0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f96927f7640 1 --2- 172.21.15.155:0/65329961 >> v2:172.21.15.155:3300/0 conn(0x7f968c151840 0x7f968c157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f96927f7640 1 -- 172.21.15.155:0/65329961 >> 172.21.15.155:0/65329961 conn(0x7f968c0c9a70 msgr2=0x7f968c0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f96927f7640 1 -- 172.21.15.155:0/65329961 shutdown_connections 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ccc022030 con 0x7f0cd40c95a0 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f609a86d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f609415ad40 0x7f60941656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f609986b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 0x7f60940cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40836/0 (socket says 172.21.15.155:40836) 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f609986b640 1 -- 172.21.15.155:0/1562299053 learned_addr learned my addr 172.21.15.155:0/1562299053 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.526+0000 7f609906a640 1 --1- 172.21.15.155:0/1562299053 >> v1:172.21.15.155:6789/0 conn(0x7f609415ed60 0x7f60940cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36252/0 (socket says 172.21.15.155:36252) 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609415b6d0 con 0x7f609415ed60 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f609415b9b0 con 0x7f609415ad40 2024-04-25T13:16:53.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f609415bc90 con 0x7f60940cb250 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f609a06c640 1 --2- 172.21.15.155:0/1562299053 >> v2:172.21.15.155:3300/0 conn(0x7f609415ad40 0x7f60941656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f6098869640 1 -- 172.21.15.155:0/1562299053 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142714869 0 0) 0x7f609415b6d0 con 0x7f609415ed60 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.527+0000 7f6098869640 1 -- 172.21.15.155:0/1562299053 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6080003520 con 0x7f609415ed60 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f609986b640 1 -- 172.21.15.155:0/1562299053 >> v2:172.21.15.155:3300/0 conn(0x7f609415ad40 msgr2=0x7f60941656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f609986b640 1 --2- 172.21.15.155:0/1562299053 >> v2:172.21.15.155:3300/0 conn(0x7f609415ad40 0x7f60941656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f609986b640 1 -- 172.21.15.155:0/1562299053 >> v1:172.21.15.155:6789/0 conn(0x7f609415ed60 legacy=0x7f60940cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f609986b640 1 -- 172.21.15.155:0/1562299053 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60940ccc20 con 0x7f60940cb250 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f609a06c640 1 --2- 172.21.15.155:0/1562299053 >> v2:172.21.15.155:3300/0 conn(0x7f609415ad40 0x7f60941656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41f4863640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41f01598a0 0x7f41f0160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41f4863640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 0x7f41f00c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41f4863640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f00c4400 0x7f41f006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41f4863640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f41f00c7d10 con 0x7f41f01598a0 2024-04-25T13:16:53.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41f4863640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f41f00c6d00 con 0x7f41f00c3800 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41f4863640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f41f00c7880 con 0x7f41f00c4400 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41eed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41f01598a0 0x7f41f0160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ee59c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 0x7f41f00c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ee59c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 0x7f41f00c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54540/0 (socket says 172.21.15.155:54540) 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41eed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41f01598a0 0x7f41f0160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54718/0 (socket says 172.21.15.155:54718) 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ee59c640 1 -- 172.21.15.155:0/1237124142 learned_addr learned my addr 172.21.15.155:0/1237124142 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ef59e640 1 --2- 172.21.15.155:0/1237124142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f00c4400 0x7f41f006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ef59e640 1 -- 172.21.15.155:0/1237124142 >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 msgr2=0x7f41f00c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ef59e640 1 --2- 172.21.15.155:0/1237124142 >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 0x7f41f00c3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ef59e640 1 -- 172.21.15.155:0/1237124142 >> v2:172.21.15.155:3300/0 conn(0x7f41f01598a0 msgr2=0x7f41f0160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ef59e640 1 --2- 172.21.15.155:0/1237124142 >> v2:172.21.15.155:3300/0 conn(0x7f41f01598a0 0x7f41f0160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ef59e640 1 -- 172.21.15.155:0/1237124142 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f0160560 con 0x7f41f00c4400 2024-04-25T13:16:53.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.528+0000 7f41ee59c640 1 --2- 172.21.15.155:0/1237124142 >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 0x7f41f00c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0011830 con 0x7f20f406f870 2024-04-25T13:16:53.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f0016070 con 0x7f20f406f870 2024-04-25T13:16:53.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bd40253f0 con 0x7f1be014f010 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0011c30 con 0x7f20f406f870 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f415af70 con 0x7f20f406f870 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41f19b0 con 0x7f20f406f870 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f5a5d6ef640 1 -- start start 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a5d6ef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 0x7f5a5814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a5d6ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a580c6e00 0x7f5a580c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a56ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 0x7f5a5814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a56ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 0x7f5a5814d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54730/0 (socket says 172.21.15.155:54730) 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a56ffd640 1 -- 172.21.15.155:0/2446532127 learned_addr learned my addr 172.21.15.155:0/2446532127 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a58152fd0 0x7f5a580c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a4e7fc640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a580c6e00 0x7f5a580c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580c8c60 con 0x7f5a58074410 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a577fe640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a58152fd0 0x7f5a580c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5815c990 con 0x7f5a580c6e00 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5a581533b0 con 0x7f5a58152fd0 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f1bdd7fa640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f1bc406c9c0 0x7f1bc406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1bd408c550 con 0x7f1be014f010 2024-04-25T13:16:53.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.530+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f1bc406c9c0 0x7f1bc406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.529+0000 7f96927f7640 1 -- 172.21.15.155:0/65329961 wait complete. 2024-04-25T13:16:53.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f41ef59e640 1 --2- 172.21.15.155:0/1237124142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f00c4400 0x7f41f006e390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41f0075e90 tx=0x7f41e802a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517676a52af614da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f609986b640 1 --2- 172.21.15.155:0/1562299053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 0x7f60940cb630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6090009870 tx=0x7f609002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf444b07dc4eb1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.556 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc005290 con 0x7f20f406f870 2024-04-25T13:16:53.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f96927f7640 1 Processor -- start 2024-04-25T13:16:53.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f6098869640 1 -- 172.21.15.155:0/1562299053 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090037070 con 0x7f60940cb250 2024-04-25T13:16:53.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f6098869640 1 -- 172.21.15.155:0/1562299053 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609002ad00 con 0x7f60940cb250 2024-04-25T13:16:53.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f6098869640 1 -- 172.21.15.155:0/1562299053 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084001670 con 0x7f60940cb250 2024-04-25T13:16:53.557 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f1be4f19640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f1bc406c9c0 0x7f1bc406ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc033000 tx=0x7f1bcc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f41edd9b640 1 -- 172.21.15.155:0/1237124142 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8007740 con 0x7f41f00c4400 2024-04-25T13:16:53.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f41edd9b640 1 -- 172.21.15.155:0/1237124142 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e80078e0 con 0x7f41f00c4400 2024-04-25T13:16:53.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f41edd9b640 1 -- 172.21.15.155:0/1237124142 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8007cb0 con 0x7f41f00c4400 2024-04-25T13:16:53.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a56ffd640 1 -- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a58152fd0 msgr2=0x7f5a580c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.558 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a56ffd640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a58152fd0 0x7f5a580c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a56ffd640 1 -- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a580c6e00 msgr2=0x7f5a580c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a56ffd640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a580c6e00 0x7f5a580c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a56ffd640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a58159590 con 0x7f5a58074410 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a577fe640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a58152fd0 0x7f5a580c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f96927f7640 1 -- start start 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.531+0000 7f5a4e7fc640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a580c6e00 0x7f5a580c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:53.559 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f5a56ffd640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 0x7f5a5814d830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d830 tx=0x7f5a4800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20f001b460 con 0x7f20f406f870 2024-04-25T13:16:53.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 msgr2=0x7f60940cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f20ea7fc640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f20d806c8f0 0x7f20d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f609a86d640 1 --2- 172.21.15.155:0/1562299053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 0x7f60940cb630 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6090009870 tx=0x7f609002a270 comp rx=0 tx=0).stop 2024-04-25T13:16:53.560 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 shutdown_connections 2024-04-25T13:16:53.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f609a86d640 1 --2- 172.21.15.155:0/1562299053 >> v2:172.21.15.155:3300/0 conn(0x7f609415ad40 0x7f60941656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f609a86d640 1 --2- 172.21.15.155:0/1562299053 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f60940cb250 0x7f60940cb630 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 >> 172.21.15.155:0/1562299053 conn(0x7f6094072f10 msgr2=0x7f6094073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f20f9aa4640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f20d806c8f0 0x7f20d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.561 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f20f008b9c0 con 0x7f20f406f870 2024-04-25T13:16:53.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f41f4863640 1 -- 172.21.15.155:0/1237124142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f00c4400 msgr2=0x7f41f006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.532+0000 7f41f4863640 1 --2- 172.21.15.155:0/1237124142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f00c4400 0x7f41f006e390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41f0075e90 tx=0x7f41e802a540 comp rx=0 tx=0).stop 2024-04-25T13:16:53.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f41f4863640 1 -- 172.21.15.155:0/1237124142 shutdown_connections 2024-04-25T13:16:53.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f41f4863640 1 --2- 172.21.15.155:0/1237124142 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f00c4400 0x7f41f006e390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f41f4863640 1 --2- 172.21.15.155:0/1237124142 >> v2:172.21.15.191:3300/0 conn(0x7f41f00c3800 0x7f41f00c3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.562 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f41f4863640 1 --2- 172.21.15.155:0/1237124142 >> v2:172.21.15.155:3300/0 conn(0x7f41f01598a0 0x7f41f0160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f41f4863640 1 -- 172.21.15.155:0/1237124142 >> 172.21.15.155:0/1237124142 conn(0x7f41f00c8e00 msgr2=0x7f41f00c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f96927f7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 0x7f968c201cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f96927f7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c151840 0x7f968c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.563 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 shutdown_connections 2024-04-25T13:16:53.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f96927f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f968c154740 0x7f968c1f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f968bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 0x7f968c201cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f609a86d640 1 -- 172.21.15.155:0/1562299053 wait complete. 2024-04-25T13:16:53.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f20f9aa4640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f20d806c8f0 0x7f20d806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20e4006fd0 tx=0x7f20e40090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f968bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 0x7f968c201cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54554/0 (socket says 172.21.15.155:54554) 2024-04-25T13:16:53.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f9690d94640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f968c154740 0x7f968c1f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f9690d94640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f968c154740 0x7f968c1f1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54746/0 (socket says 172.21.15.155:54746) 2024-04-25T13:16:53.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f968b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c151840 0x7f968c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f968b7fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c151840 0x7f968c151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:40862/0 (socket says 172.21.15.155:40862) 2024-04-25T13:16:53.565 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.533+0000 7f968bfff640 1 -- 172.21.15.155:0/3118935136 learned_addr learned my addr 172.21.15.155:0/3118935136 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0c3290 con 0x7f968c154740 2024-04-25T13:16:53.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1bd4018030 con 0x7f1be014f010 2024-04-25T13:16:53.566 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f41f4863640 1 -- 172.21.15.155:0/1237124142 shutdown_connections 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0c2fb0 con 0x7f968c06d560 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f968c0c3570 con 0x7f968c151840 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f609a86d640 1 Processor -- start 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f609a86d640 1 -- start start 2024-04-25T13:16:53.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.534+0000 7f41f4863640 1 -- 172.21.15.155:0/1237124142 wait complete. 2024-04-25T13:16:53.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f968bfff640 1 -- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c151840 msgr2=0x7f968c151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f968bfff640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c151840 0x7f968c151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f968bfff640 1 -- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f968c154740 msgr2=0x7f968c1f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f968bfff640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f968c154740 0x7f968c1f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f968bfff640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c0ccd70 con 0x7f968c06d560 2024-04-25T13:16:53.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f968bfff640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 0x7f968c201cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9684007ef0 tx=0x7f968400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f609a86d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60940cb250 0x7f609414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f609a86d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f609415ad40 0x7f60940b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609a86d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f609415ed60 0x7f60941f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609a86d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60940cc370 con 0x7f609415ed60 2024-04-25T13:16:53.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f41f4863640 1 Processor -- start 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609a86d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f60940cd1e0 con 0x7f60940cb250 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609a86d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f609415f180 con 0x7f609415ad40 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609986b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60940cb250 0x7f609414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f609415ad40 0x7f60940b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609986b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60940cb250 0x7f609414ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:54568/0 (socket says 172.21.15.155:54568) 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609986b640 1 -- 172.21.15.155:0/3760259061 learned_addr learned my addr 172.21.15.155:0/3760259061 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968401a070 con 0x7f968c06d560 2024-04-25T13:16:53.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684003b90 con 0x7f968c06d560 2024-04-25T13:16:53.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.535+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684004030 con 0x7f968c06d560 2024-04-25T13:16:53.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609a06c640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f609415ed60 0x7f60941f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c0cc7d0 con 0x7f968c06d560 2024-04-25T13:16:53.571 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f41f4863640 1 -- start start 2024-04-25T13:16:53.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 -- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60940cb250 msgr2=0x7f609414ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60940cb250 0x7f609414ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 -- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f609415ed60 msgr2=0x7f60941f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f609415ed60 0x7f60941f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 -- 172.21.15.155:0/3760259061 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6094150610 con 0x7f609415ad40 2024-04-25T13:16:53.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.536+0000 7f609906a640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f609415ad40 0x7f60940b5b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f608400c7b0 tx=0x7f608400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1fdf00 con 0x7f968c06d560 2024-04-25T13:16:53.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084018070 con 0x7f609415ad40 2024-04-25T13:16:53.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60840072d0 con 0x7f609415ad40 2024-04-25T13:16:53.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840047e0 con 0x7f609415ad40 2024-04-25T13:16:53.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60940ca5b0 con 0x7f609415ad40 2024-04-25T13:16:53.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60941508b0 con 0x7f609415ad40 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f41f4863640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41f00c3800 0x7f41f015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.537+0000 7f41f4863640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 0x7f41f01549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41f4863640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f01598a0 0x7f41f015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41f4863640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41f00c6f50 con 0x7f41f00c4400 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41f4863640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f41f0159c80 con 0x7f41f00c3800 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41f4863640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f41f00c7230 con 0x7f41f01598a0 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 0x7f41f01549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 0x7f41f01549c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54770/0 (socket says 172.21.15.155:54770) 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 -- 172.21.15.155:0/858893386 learned_addr learned my addr 172.21.15.155:0/858893386 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 -- 172.21.15.155:0/858893386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f01598a0 msgr2=0x7f41f015b2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:16:53.575 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f01598a0 0x7f41f015b2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 -- 172.21.15.155:0/858893386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41f00c3800 msgr2=0x7f41f015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.538+0000 7f41ee59c640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41f00c3800 0x7f41f015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f41ee59c640 1 -- 172.21.15.155:0/858893386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f015ce10 con 0x7f41f00c4400 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60940cac20 con 0x7f609415ad40 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f41ee59c640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 0x7f41f01549c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f41e400e8d0 tx=0x7f41e400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f20f008de20 con 0x7f20f406f870 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6084004980 con 0x7f609415ad40 2024-04-25T13:16:53.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4004030 con 0x7f41f00c4400 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e40041d0 con 0x7f41f00c4400 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e400c940 con 0x7f41f00c4400 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f01fe4f0 con 0x7f41f00c4400 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f015a780 con 0x7f41f00c4400 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f608a7fc640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f607806c920 0x7f607806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f608408b1b0 con 0x7f609415ad40 2024-04-25T13:16:53.578 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.541+0000 7f609986b640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f607806c920 0x7f607806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800b6c0 con 0x7f5a58074410 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a48019070 con 0x7f5a58074410 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800ba80 con 0x7f5a58074410 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a581e23e0 con 0x7f5a58074410 2024-04-25T13:16:53.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a581578c0 con 0x7f5a58074410 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.539+0000 7f96827fc640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c068e40 con 0x7f968c06d560 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f968401d070 con 0x7f968c06d560 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.540+0000 7f9688ff9640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f966c06c9f0 0x7f966c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.541+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f968408c110 con 0x7f968c06d560 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.541+0000 7f968b7fe640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f966c06c9f0 0x7f966c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.542+0000 7f968b7fe640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f966c06c9f0 0x7f966c06eeb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f967c038000 tx=0x7f967c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.542+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f015a9c0 con 0x7f41f00c4400 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.542+0000 7f609986b640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f607806c920 0x7f607806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6090009630 tx=0x7f609002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.543+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41e400cae0 con 0x7f41f00c4400 2024-04-25T13:16:53.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.543+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a58068e40 con 0x7f5a58074410 2024-04-25T13:16:53.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.543+0000 7f41d77fe640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f41dc06c9f0 0x7f41dc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.543+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a4800bc20 con 0x7f5a58074410 2024-04-25T13:16:53.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.544+0000 7f41eed9d640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f41dc06c9f0 0x7f41dc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.544+0000 7f41eed9d640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f41dc06c9f0 0x7f41dc06eeb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41e0006a90 tx=0x7f41e0006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.544+0000 7f5a4ffff640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a3806c9c0 0x7f5a3806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.544+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5a4808c1f0 con 0x7f5a58074410 2024-04-25T13:16:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.544+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f41e408bce0 con 0x7f41f00c4400 2024-04-25T13:16:53.586 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.545+0000 7f5a4e7fc640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a3806c9c0 0x7f5a3806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.545+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9684010070 con 0x7f968c06d560 2024-04-25T13:16:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.544+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f60940cac20 con 0x7f609415ad40 2024-04-25T13:16:53.587 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.545+0000 7f5a4e7fc640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a3806c9c0 0x7f5a3806ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a40034000 tx=0x7f5a4002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.553+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41f015a9c0 con 0x7f41f00c4400 2024-04-25T13:16:53.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.556+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a48059c70 con 0x7f5a58074410 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.680+0000 7f2866f0d640 1 Processor -- start 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.680+0000 7f2866f0d640 1 -- start start 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f2866f0d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f28580dd710 0x7f2858049170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f2866f0d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f285804ed90 0x7f285804f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f2866f0d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2858037a00 con 0x7f285804e460 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f2866f0d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f285804e8b0 con 0x7f28580dd710 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f2866f0d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2858037ce0 con 0x7f285804ed90 2024-04-25T13:16:53.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f286570a640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f285804e460 0x7f28580e6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36254/0 (socket says 172.21.15.155:36254) 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.682+0000 7f286570a640 1 -- 172.21.15.155:0/1064091652 learned_addr learned my addr 172.21.15.155:0/1064091652 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299050290 0 0) 0x7f2858037a00 con 0x7f285804e460 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f284c003520 con 0x7f285804e460 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 912727027 0 0) 0x7f284c003520 con 0x7f285804e460 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f285804ed90 msgr2=0x7f285804f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f285804ed90 0x7f285804f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 >> v2:172.21.15.191:3300/0 conn(0x7f28580dd710 msgr2=0x7f2858049170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 --2- 172.21.15.155:0/1064091652 >> v2:172.21.15.191:3300/0 conn(0x7f28580dd710 0x7f2858049170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2858037fc0 con 0x7f285804e460 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f2860074ad0 con 0x7f285804e460 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.683+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 >> v1:172.21.15.155:6789/0 conn(0x7f285804e460 legacy=0x7f28580e6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2864f09640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c003a30 0x7f284c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2864f09640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f284c004800 0x7f284c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2864f09640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f284c0051c0 0x7f284c02d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2858037ce0 con 0x7f284c003a30 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f284c02e020 con 0x7f284c0051c0 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f284c02e220 con 0x7f284c004800 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.684+0000 7f2865f0b640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c003a30 0x7f284c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.685+0000 7f2865f0b640 1 -- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f284c004800 msgr2=0x7f284c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.685+0000 7f2865f0b640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f284c004800 0x7f284c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.685+0000 7f2865f0b640 1 -- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f284c0051c0 msgr2=0x7f284c02d9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.685+0000 7f2865f0b640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f284c0051c0 0x7f284c02d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.685+0000 7f2865f0b640 1 -- 172.21.15.155:0/1064091652 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c003520 con 0x7f284c003a30 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.686+0000 7f2865f0b640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c003a30 0x7f284c003e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2850009a40 tx=0x7f284c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb8b174ba35af27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.686+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850037070 con 0x7f284c003a30 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.686+0000 7f2864f09640 1 -- 172.21.15.155:0/1064091652 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285002acb0 con 0x7f284c003a30 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.687+0000 7f2866f0d640 1 -- 172.21.15.155:0/1064091652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c003a30 msgr2=0x7f284c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.687+0000 7f2866f0d640 1 --2- 172.21.15.155:0/1064091652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c003a30 0x7f284c003e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2850009a40 tx=0x7f284c005830 comp rx=0 tx=0).stop 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.689+0000 7f286670c640 1 -- 172.21.15.155:0/1064091652 reap_dead start 2024-04-25T13:16:53.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.689+0000 7f2866f0d640 1 -- 172.21.15.155:0/1064091652 shutdown_connections 2024-04-25T13:16:53.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.689+0000 7f2866f0d640 1 -- 172.21.15.155:0/1064091652 >> 172.21.15.155:0/1064091652 conn(0x7f285800e070 msgr2=0x7f285800e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.690+0000 7f2866f0d640 1 -- 172.21.15.155:0/1064091652 shutdown_connections 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.690+0000 7f2866f0d640 1 -- 172.21.15.155:0/1064091652 wait complete. 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.691+0000 7f2866f0d640 1 Processor -- start 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.691+0000 7f2866f0d640 1 -- start start 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2866f0d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 0x7f28581964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2866f0d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2858052f40 0x7f28580c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2866f0d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28580c91f0 0x7f28580ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2866f0d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2858037680 con 0x7f28581960e0 2024-04-25T13:16:53.696 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2866f0d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f28580e6950 con 0x7f28580c91f0 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2866f0d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2858036010 con 0x7f2858052f40 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2865f0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 0x7f28581964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2865f0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 0x7f28581964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54796/0 (socket says 172.21.15.155:54796) 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.693+0000 7f2865f0b640 1 -- 172.21.15.155:0/4243493540 learned_addr learned my addr 172.21.15.155:0/4243493540 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.694+0000 7f2865f0b640 1 -- 172.21.15.155:0/4243493540 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2858052f40 msgr2=0x7f28580c8cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.694+0000 7f2865f0b640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2858052f40 0x7f28580c8cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.694+0000 7f2865f0b640 1 -- 172.21.15.155:0/4243493540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28580c91f0 msgr2=0x7f28580ca100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.694+0000 7f2865f0b640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28580c91f0 0x7f28580ca100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.694+0000 7f2865f0b640 1 -- 172.21.15.155:0/4243493540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28580497e0 con 0x7f28581960e0 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.694+0000 7f2865f0b640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 0x7f28581964c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2850000ef0 tx=0x7f2850004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.697 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.695+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850037050 con 0x7f28581960e0 2024-04-25T13:16:53.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.696+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2858196aa0 con 0x7f28581960e0 2024-04-25T13:16:53.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.696+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28580cbcf0 con 0x7f28581960e0 2024-04-25T13:16:53.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.698+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850043070 con 0x7f28581960e0 2024-04-25T13:16:53.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.699+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285003c8e0 con 0x7f28581960e0 2024-04-25T13:16:53.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.699+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f285003ca80 con 0x7f28581960e0 2024-04-25T13:16:53.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.699+0000 7f28567fc640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f284406ca20 0x7f284406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:53.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.700+0000 7f286570a640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f284406ca20 0x7f284406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:53.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.700+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f28500ac980 con 0x7f28581960e0 2024-04-25T13:16:53.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.700+0000 7f286570a640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f284406ca20 0x7f284406eee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f286006a140 tx=0x7f286006aed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:53.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.702+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2848005290 con 0x7f28581960e0 2024-04-25T13:16:53.711 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.711+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f285007ab70 con 0x7f28581960e0 2024-04-25T13:16:53.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.943+0000 7f96827fc640 1 -- 172.21.15.155:0/3118935136 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f968c1550c0 con 0x7f968c06d560 2024-04-25T13:16:53.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.943+0000 7f9688ff9640 1 -- 172.21.15.155:0/3118935136 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9684059b90 con 0x7f968c06d560 2024-04-25T13:16:53.943 INFO:teuthology.orchestra.run.smithi155.stdout:55834574860 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f966c06c9f0 msgr2=0x7f966c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f966c06c9f0 0x7f966c06eeb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f967c038000 tx=0x7f967c009040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 msgr2=0x7f968c201cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 0x7f968c201cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9684007ef0 tx=0x7f968400d4a0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 shutdown_connections 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f968c154740 0x7f968c1f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f966c06c9f0 0x7f966c06eeb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f968c151840 0x7f968c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.947+0000 7f96927f7640 1 --2- 172.21.15.155:0/3118935136 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f968c06d560 0x7f968c201cd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.948+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 >> 172.21.15.155:0/3118935136 conn(0x7f968c0c9a70 msgr2=0x7f968c0733b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.948+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 shutdown_connections 2024-04-25T13:16:53.948 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.948+0000 7f96927f7640 1 -- 172.21.15.155:0/3118935136 wait complete. 2024-04-25T13:16:53.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.955+0000 7f1be717d640 1 -- 172.21.15.155:0/3087145491 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1be00cd3e0 con 0x7f1be014f010 2024-04-25T13:16:53.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.956+0000 7f1bdd7fa640 1 -- 172.21.15.155:0/3087145491 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bd405a6b0 con 0x7f1be014f010 2024-04-25T13:16:53.955 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.959+0000 7f1bcaffd640 1 -- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f1bc406c9c0 msgr2=0x7f1bc406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.959+0000 7f1bcaffd640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f1bc406c9c0 0x7f1bc406ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc033000 tx=0x7f1bcc02e000 comp rx=0 tx=0).stop 2024-04-25T13:16:53.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 -- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 msgr2=0x7f1be00cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 0x7f1be00cf560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40107f0 tx=0x7f1bd4010bf0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 -- 172.21.15.155:0/3087145491 shutdown_connections 2024-04-25T13:16:53.960 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f1bc406c9c0 0x7f1bc406ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f1be0147d50 0x7f1be01481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1be014f010 0x7f1be00cf560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 --2- 172.21.15.155:0/3087145491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1be014ec30 0x7f1be00cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.960+0000 7f1bcaffd640 1 -- 172.21.15.155:0/3087145491 >> 172.21.15.155:0/3087145491 conn(0x7f1be0074d50 msgr2=0x7f1be00c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.963+0000 7f1bcaffd640 1 -- 172.21.15.155:0/3087145491 shutdown_connections 2024-04-25T13:16:53.962 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.963+0000 7f1bcaffd640 1 -- 172.21.15.155:0/3087145491 wait complete. 2024-04-25T13:16:53.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2024-04-25T13:16:53.965 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:53.969 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.969+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0cd40702b0 con 0x7f0cd40c95a0 2024-04-25T13:16:53.969 INFO:teuthology.orchestra.run.smithi155.stdout:55834574858 2024-04-25T13:16:53.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.969+0000 7f0cc2ffd640 1 -- 172.21.15.155:0/1774236606 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ccc010040 con 0x7f0cd40c95a0 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0cb406c9c0 msgr2=0x7f0cb406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0cb406c9c0 0x7f0cb406ee80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4006a90 tx=0x7f0cc4008040 comp rx=0 tx=0).stop 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 msgr2=0x7f0cd415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd415aa80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc00eba0 tx=0x7f0ccc00c490 comp rx=0 tx=0).stop 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 shutdown_connections 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0cb406c9c0 0x7f0cb406ee80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0cd40c95a0 0x7f0cd415aa80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0cd406bf70 0x7f0cd415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 --2- 172.21.15.155:0/1774236606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cd406bb90 0x7f0cd4161bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 >> 172.21.15.155:0/1774236606 conn(0x7f0cd4074d50 msgr2=0x7f0cd41561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 shutdown_connections 2024-04-25T13:16:53.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.973+0000 7f0cd8afd640 1 -- 172.21.15.155:0/1774236606 wait complete. 2024-04-25T13:16:53.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.974+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f20dc005850 con 0x7f20f406f870 2024-04-25T13:16:53.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.975+0000 7f20ea7fc640 1 -- 172.21.15.155:0/927469262 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20f0059460 con 0x7f20f406f870 2024-04-25T13:16:53.975 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.977+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6094154e20 con 0x7f609415ad40 2024-04-25T13:16:53.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.977+0000 7f608a7fc640 1 -- 172.21.15.155:0/3760259061 <== mon.2 v2:172.21.15.191:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6094154e20 con 0x7f609415ad40 2024-04-25T13:16:53.978 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.978+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f20d806c8f0 msgr2=0x7f20d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.978+0000 7f20fbd08640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f20d806c8f0 0x7f20d806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20e4006fd0 tx=0x7f20e40090e0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.978+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 msgr2=0x7f20f4158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.978+0000 7f20fbd08640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f4158ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b3c0 tx=0x7f20f000b880 comp rx=0 tx=0).stop 2024-04-25T13:16:53.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-25T13:16:53.980 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 shutdown_connections 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20f406f870 0x7f20f4158ca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20f406ec30 0x7f20f4158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f20d806c8f0 0x7f20d806edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 --2- 172.21.15.155:0/927469262 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f20f406e850 0x7f20f414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 >> 172.21.15.155:0/927469262 conn(0x7f20f40c8f00 msgr2=0x7f20f4156f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 shutdown_connections 2024-04-25T13:16:53.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.979+0000 7f20fbd08640 1 -- 172.21.15.155:0/927469262 wait complete. 2024-04-25T13:16:53.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.981+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f41f0068cc0 con 0x7f41f00c4400 2024-04-25T13:16:53.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f607806c920 msgr2=0x7f607806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f607806c920 0x7f607806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6090009630 tx=0x7f609002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:53.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f609415ad40 msgr2=0x7f60940b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f609415ad40 0x7f60940b5b00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f608400c7b0 tx=0x7f608400cc70 comp rx=0 tx=0).stop 2024-04-25T13:16:53.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f41d77fe640 1 -- 172.21.15.155:0/858893386 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41e4017020 con 0x7f41f00c4400 2024-04-25T13:16:53.982 INFO:teuthology.orchestra.run.smithi155.stdout:55834574860 2024-04-25T13:16:53.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 shutdown_connections 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f609415ed60 0x7f60941f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f607806c920 0x7f607806ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f609415ad40 0x7f60940b5b00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 --2- 172.21.15.155:0/3760259061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60940cb250 0x7f609414ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 >> 172.21.15.155:0/3760259061 conn(0x7f6094072f10 msgr2=0x7f60940cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 shutdown_connections 2024-04-25T13:16:53.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.982+0000 7f609a86d640 1 -- 172.21.15.155:0/3760259061 wait complete. 2024-04-25T13:16:53.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.985+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f41dc06c9f0 msgr2=0x7f41dc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.985+0000 7f41f4863640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f41dc06c9f0 0x7f41dc06eeb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41e0006a90 tx=0x7f41e0006a20 comp rx=0 tx=0).stop 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.985+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 msgr2=0x7f41f01549c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.985+0000 7f41f4863640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 0x7f41f01549c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f41e400e8d0 tx=0x7f41e400ed90 comp rx=0 tx=0).stop 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 shutdown_connections 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f41dc06c9f0 0x7f41dc06eeb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f41f01598a0 0x7f41f015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f00c4400 0x7f41f01549c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 --2- 172.21.15.155:0/858893386 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41f00c3800 0x7f41f015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 >> 172.21.15.155:0/858893386 conn(0x7f41f00c8e00 msgr2=0x7f41f00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 shutdown_connections 2024-04-25T13:16:53.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.986+0000 7f41f4863640 1 -- 172.21.15.155:0/858893386 wait complete. 2024-04-25T13:16:53.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-25T13:16:53.991 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:53.996 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.996+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5a5814bef0 con 0x7f5a58074410 2024-04-25T13:16:53.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-25T13:16:53.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:53.997+0000 7f5a4ffff640 1 -- 172.21.15.155:0/2446532127 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a4805df70 con 0x7f5a58074410 2024-04-25T13:16:53.997 INFO:teuthology.orchestra.run.smithi155.stdout:55834574859 2024-04-25T13:16:53.997 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:53.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-04-25T13:16:53.998 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:54.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a3806c9c0 msgr2=0x7f5a3806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a3806c9c0 0x7f5a3806ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a40034000 tx=0x7f5a4002e000 comp rx=0 tx=0).stop 2024-04-25T13:16:54.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 msgr2=0x7f5a5814d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 0x7f5a5814d830 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d830 tx=0x7f5a4800dcf0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 shutdown_connections 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a3806c9c0 0x7f5a3806ee80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5a58152fd0 0x7f5a580c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5a580c6e00 0x7f5a580c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 --2- 172.21.15.155:0/2446532127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a58074410 0x7f5a5814d830 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 >> 172.21.15.155:0/2446532127 conn(0x7f5a580c8f00 msgr2=0x7f5a5815a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 shutdown_connections 2024-04-25T13:16:54.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.000+0000 7f5a5d6ef640 1 -- 172.21.15.155:0/2446532127 wait complete. 2024-04-25T13:16:54.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2024-04-25T13:16:54.004 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:54.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-25T13:16:54.012 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:54.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.042+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2848005580 con 0x7f28581960e0 2024-04-25T13:16:54.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.043+0000 7f28567fc640 1 -- 172.21.15.155:0/4243493540 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f285007a470 con 0x7f28581960e0 2024-04-25T13:16:54.043 INFO:teuthology.orchestra.run.smithi155.stdout:55834574860 2024-04-25T13:16:54.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f284406ca20 msgr2=0x7f284406eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f284406ca20 0x7f284406eee0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f286006a140 tx=0x7f286006aed0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 msgr2=0x7f28581964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 0x7f28581964c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2850000ef0 tx=0x7f2850004750 comp rx=0 tx=0).stop 2024-04-25T13:16:54.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 shutdown_connections 2024-04-25T13:16:54.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28580c91f0 0x7f28580ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f284406ca20 0x7f284406eee0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2858052f40 0x7f28580c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 --2- 172.21.15.155:0/4243493540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28581960e0 0x7f28581964c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 >> 172.21.15.155:0/4243493540 conn(0x7f285800e070 msgr2=0x7f28580dc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 shutdown_connections 2024-04-25T13:16:54.046 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.045+0000 7f2866f0d640 1 -- 172.21.15.155:0/4243493540 wait complete. 2024-04-25T13:16:54.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2024-04-25T13:16:54.056 DEBUG:teuthology.parallel:result is None 2024-04-25T13:16:54.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:16:54.056 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:54.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.193+0000 7fe31dbfe640 1 Processor -- start 2024-04-25T13:16:54.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.193+0000 7fe31dbfe640 1 -- start start 2024-04-25T13:16:54.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe31dbfe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe3180b2b50 0x7fe318072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe31dbfe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe318074390 0x7fe3180728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe31dbfe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe3180c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe31dbfe640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe3180b2f30 con 0x7fe318074390 2024-04-25T13:16:54.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe31dbfe640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe3180c8270 con 0x7fe3180b2b50 2024-04-25T13:16:54.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe31dbfe640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180c9390 con 0x7fe3180c89e0 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe318074390 0x7fe3180728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe318074390 0x7fe3180728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54806/0 (socket says 172.21.15.155:54806) 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 -- 172.21.15.155:0/1771662049 learned_addr learned my addr 172.21.15.155:0/1771662049 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe3177fe640 1 --2- 172.21.15.155:0/1771662049 >> v2:172.21.15.191:3300/0 conn(0x7fe3180b2b50 0x7fe318072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe317fff640 1 --2- 172.21.15.155:0/1771662049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe3180c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 -- 172.21.15.155:0/1771662049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 msgr2=0x7fe3180c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 --2- 172.21.15.155:0/1771662049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe3180c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 -- 172.21.15.155:0/1771662049 >> v2:172.21.15.191:3300/0 conn(0x7fe3180b2b50 msgr2=0x7fe318072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 --2- 172.21.15.155:0/1771662049 >> v2:172.21.15.191:3300/0 conn(0x7fe3180b2b50 0x7fe318072390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe316ffd640 1 -- 172.21.15.155:0/1771662049 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe318159de0 con 0x7fe318074390 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.194+0000 7fe3177fe640 1 --2- 172.21.15.155:0/1771662049 >> v2:172.21.15.191:3300/0 conn(0x7fe3180b2b50 0x7fe318072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:54.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.195+0000 7fe316ffd640 1 --2- 172.21.15.155:0/1771662049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe318074390 0x7fe3180728d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3180680d0 tx=0x7fe30c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daf1c076ff6b33d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.195+0000 7fe3167fc640 1 -- 172.21.15.155:0/1771662049 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c037070 con 0x7fe318074390 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.195+0000 7fe3167fc640 1 -- 172.21.15.155:0/1771662049 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c032440 con 0x7fe318074390 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.195+0000 7fe3167fc640 1 -- 172.21.15.155:0/1771662049 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c032810 con 0x7fe318074390 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.195+0000 7fe31dbfe640 1 -- 172.21.15.155:0/1771662049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe318074390 msgr2=0x7fe3180728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.195+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/1771662049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe318074390 0x7fe3180728d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe3180680d0 tx=0x7fe30c02a270 comp rx=0 tx=0).stop 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 -- 172.21.15.155:0/1771662049 shutdown_connections 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/1771662049 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe3180c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/1771662049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe318074390 0x7fe3180728d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/1771662049 >> v2:172.21.15.191:3300/0 conn(0x7fe3180b2b50 0x7fe318072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 -- 172.21.15.155:0/1771662049 >> 172.21.15.155:0/1771662049 conn(0x7fe3180c9a70 msgr2=0x7fe3180c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 -- 172.21.15.155:0/1771662049 shutdown_connections 2024-04-25T13:16:54.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.196+0000 7fe31dbfe640 1 -- 172.21.15.155:0/1771662049 wait complete. 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.197+0000 7fe31dbfe640 1 Processor -- start 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.197+0000 7fe31dbfe640 1 -- start start 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe318074390 0x7fe318150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 0x7fe31806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe31814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe318072010 con 0x7fe3180b2b50 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe318071d30 con 0x7fe318074390 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180c84c0 con 0x7fe3180c89e0 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 0x7fe31806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 0x7fe31806f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54812/0 (socket says 172.21.15.155:54812) 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 -- 172.21.15.155:0/3912126393 learned_addr learned my addr 172.21.15.155:0/3912126393 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe3177fe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe318074390 0x7fe318150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe317fff640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe31814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 -- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 msgr2=0x7fe31814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe31814a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 -- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe318074390 msgr2=0x7fe318150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe318074390 0x7fe318150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 -- 172.21.15.155:0/3912126393 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31814f7d0 con 0x7fe3180b2b50 2024-04-25T13:16:54.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe316ffd640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 0x7fe31806f5c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe30c02a2b0 tx=0x7fe30c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c041020 con 0x7fe3180b2b50 2024-04-25T13:16:54.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c03d620 con 0x7fe3180b2b50 2024-04-25T13:16:54.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31814fa50 con 0x7fe3180b2b50 2024-04-25T13:16:54.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c037040 con 0x7fe3180b2b50 2024-04-25T13:16:54.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.198+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe318150010 con 0x7fe3180b2b50 2024-04-25T13:16:54.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.199+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe318068e40 con 0x7fe3180b2b50 2024-04-25T13:16:54.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.200+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe30c044020 con 0x7fe3180b2b50 2024-04-25T13:16:54.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.200+0000 7fe2fffff640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe30406c920 0x7fe30406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.200+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe30c0ac3a0 con 0x7fe3180b2b50 2024-04-25T13:16:54.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.200+0000 7fe3177fe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe30406c920 0x7fe30406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.201+0000 7fe3177fe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe30406c920 0x7fe30406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe308009560 tx=0x7fe308009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.205+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe30c04b030 con 0x7fe3180b2b50 2024-04-25T13:16:54.376 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.376+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3180c9060 con 0x7fe30406c920 2024-04-25T13:16:54.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.383+0000 7fe2fffff640 1 -- 172.21.15.155:0/3912126393 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fe3180c9060 con 0x7fe30406c920 2024-04-25T13:16:54.387 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:54.388 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:16:54.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe30406c920 msgr2=0x7fe30406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe30406c920 0x7fe30406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe308009560 tx=0x7fe308009190 comp rx=0 tx=0).stop 2024-04-25T13:16:54.390 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 msgr2=0x7fe31806f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 0x7fe31806f5c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe30c02a2b0 tx=0x7fe30c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 shutdown_connections 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe30406c920 0x7fe30406ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe3180c89e0 0x7fe31814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3180b2b50 0x7fe31806f5c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 --2- 172.21.15.155:0/3912126393 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe318074390 0x7fe318150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 >> 172.21.15.155:0/3912126393 conn(0x7fe3180c9a70 msgr2=0x7fe3180676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 shutdown_connections 2024-04-25T13:16:54.391 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.387+0000 7fe31dbfe640 1 -- 172.21.15.155:0/3912126393 wait complete. 2024-04-25T13:16:54.398 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T13:16:53.623336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002937"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000719+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:16:27.000719+0000","last_peered":"2024-04-25T13:16:27.000719+0000","last_clean":"2024-04-25T13:16:27.000719+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:16:27.000719+0000","last_undegraded":"2024-04-25T13:16:27.000719+0000","last_fullsized":"2024-04-25T13:16:27.000719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000852+0000","last_change":"2024-04-25T13:16:21.677923+0000","last_active":"2024-04-25T13:16:27.000852+0000","last_peered":"2024-04-25T13:16:27.000852+0000","last_clean":"2024-04-25T13:16:27.000852+0000","last_became_active":"2024-04-25T13:16:21.676720+0000","last_became_peered":"2024-04-25T13:16:21.676720+0000","last_unstale":"2024-04-25T13:16:27.000852+0000","last_undegraded":"2024-04-25T13:16:27.000852+0000","last_fullsized":"2024-04-25T13:16:27.000852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:31.190458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000250+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:16:27.000250+0000","last_peered":"2024-04-25T13:16:27.000250+0000","last_clean":"2024-04-25T13:16:27.000250+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:16:27.000250+0000","last_undegraded":"2024-04-25T13:16:27.000250+0000","last_fullsized":"2024-04-25T13:16:27.000250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001016+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:16:27.001016+0000","last_peered":"2024-04-25T13:16:27.001016+0000","last_clean":"2024-04-25T13:16:27.001016+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:16:27.001016+0000","last_undegraded":"2024-04-25T13:16:27.001016+0000","last_fullsized":"2024-04-25T13:16:27.001016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000593+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:16:27.000593+0000","last_peered":"2024-04-25T13:16:27.000593+0000","last_clean":"2024-04-25T13:16:27.000593+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:16:27.000593+0000","last_undegraded":"2024-04-25T13:16:27.000593+0000","last_fullsized":"2024-04-25T13:16:27.000593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999478+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:16:26.999478+0000","last_peered":"2024-04-25T13:16:26.999478+0000","last_clean":"2024-04-25T13:16:26.999478+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:16:26.999478+0000","last_undegraded":"2024-04-25T13:16:26.999478+0000","last_fullsized":"2024-04-25T13:16:26.999478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687893+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:16:26.687893+0000","last_peered":"2024-04-25T13:16:26.687893+0000","last_clean":"2024-04-25T13:16:26.687893+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:16:26.687893+0000","last_undegraded":"2024-04-25T13:16:26.687893+0000","last_fullsized":"2024-04-25T13:16:26.687893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828472+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:16:26.828472+0000","last_peered":"2024-04-25T13:16:26.828472+0000","last_clean":"2024-04-25T13:16:26.828472+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:16:26.828472+0000","last_undegraded":"2024-04-25T13:16:26.828472+0000","last_fullsized":"2024-04-25T13:16:26.828472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000162+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:16:27.000162+0000","last_peered":"2024-04-25T13:16:27.000162+0000","last_clean":"2024-04-25T13:16:27.000162+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:16:27.000162+0000","last_undegraded":"2024-04-25T13:16:27.000162+0000","last_fullsized":"2024-04-25T13:16:27.000162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688119+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:16:26.688119+0000","last_peered":"2024-04-25T13:16:26.688119+0000","last_clean":"2024-04-25T13:16:26.688119+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:16:26.688119+0000","last_undegraded":"2024-04-25T13:16:26.688119+0000","last_fullsized":"2024-04-25T13:16:26.688119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828686+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:16:26.828686+0000","last_peered":"2024-04-25T13:16:26.828686+0000","last_clean":"2024-04-25T13:16:26.828686+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:16:26.828686+0000","last_undegraded":"2024-04-25T13:16:26.828686+0000","last_fullsized":"2024-04-25T13:16:26.828686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999572+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:16:26.999572+0000","last_peered":"2024-04-25T13:16:26.999572+0000","last_clean":"2024-04-25T13:16:26.999572+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:16:26.999572+0000","last_undegraded":"2024-04-25T13:16:26.999572+0000","last_fullsized":"2024-04-25T13:16:26.999572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688207+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:16:26.688207+0000","last_peered":"2024-04-25T13:16:26.688207+0000","last_clean":"2024-04-25T13:16:26.688207+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:16:26.688207+0000","last_undegraded":"2024-04-25T13:16:26.688207+0000","last_fullsized":"2024-04-25T13:16:26.688207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000138+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:16:27.000138+0000","last_peered":"2024-04-25T13:16:27.000138+0000","last_clean":"2024-04-25T13:16:27.000138+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:16:27.000138+0000","last_undegraded":"2024-04-25T13:16:27.000138+0000","last_fullsized":"2024-04-25T13:16:27.000138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000505+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:16:27.000505+0000","last_peered":"2024-04-25T13:16:27.000505+0000","last_clean":"2024-04-25T13:16:27.000505+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:16:27.000505+0000","last_undegraded":"2024-04-25T13:16:27.000505+0000","last_fullsized":"2024-04-25T13:16:27.000505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687372+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:16:26.687372+0000","last_peered":"2024-04-25T13:16:26.687372+0000","last_clean":"2024-04-25T13:16:26.687372+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:16:26.687372+0000","last_undegraded":"2024-04-25T13:16:26.687372+0000","last_fullsized":"2024-04-25T13:16:26.687372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999884+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:16:26.999884+0000","last_peered":"2024-04-25T13:16:26.999884+0000","last_clean":"2024-04-25T13:16:26.999884+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:16:26.999884+0000","last_undegraded":"2024-04-25T13:16:26.999884+0000","last_fullsized":"2024-04-25T13:16:26.999884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001079+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:16:27.001079+0000","last_peered":"2024-04-25T13:16:27.001079+0000","last_clean":"2024-04-25T13:16:27.001079+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:16:27.001079+0000","last_undegraded":"2024-04-25T13:16:27.001079+0000","last_fullsized":"2024-04-25T13:16:27.001079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687469+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:16:26.687469+0000","last_peered":"2024-04-25T13:16:26.687469+0000","last_clean":"2024-04-25T13:16:26.687469+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:16:26.687469+0000","last_undegraded":"2024-04-25T13:16:26.687469+0000","last_fullsized":"2024-04-25T13:16:26.687469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687887+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:16:26.687887+0000","last_peered":"2024-04-25T13:16:26.687887+0000","last_clean":"2024-04-25T13:16:26.687887+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:16:26.687887+0000","last_undegraded":"2024-04-25T13:16:26.687887+0000","last_fullsized":"2024-04-25T13:16:26.687887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999794+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:16:26.999794+0000","last_peered":"2024-04-25T13:16:26.999794+0000","last_clean":"2024-04-25T13:16:26.999794+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:16:26.999794+0000","last_undegraded":"2024-04-25T13:16:26.999794+0000","last_fullsized":"2024-04-25T13:16:26.999794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000168+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:16:27.000168+0000","last_peered":"2024-04-25T13:16:27.000168+0000","last_clean":"2024-04-25T13:16:27.000168+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:16:27.000168+0000","last_undegraded":"2024-04-25T13:16:27.000168+0000","last_fullsized":"2024-04-25T13:16:27.000168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.689047+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:16:26.689047+0000","last_peered":"2024-04-25T13:16:26.689047+0000","last_clean":"2024-04-25T13:16:26.689047+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:16:26.689047+0000","last_undegraded":"2024-04-25T13:16:26.689047+0000","last_fullsized":"2024-04-25T13:16:26.689047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999769+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:16:26.999769+0000","last_peered":"2024-04-25T13:16:26.999769+0000","last_clean":"2024-04-25T13:16:26.999769+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:16:26.999769+0000","last_undegraded":"2024-04-25T13:16:26.999769+0000","last_fullsized":"2024-04-25T13:16:26.999769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001113+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:16:27.001113+0000","last_peered":"2024-04-25T13:16:27.001113+0000","last_clean":"2024-04-25T13:16:27.001113+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:16:27.001113+0000","last_undegraded":"2024-04-25T13:16:27.001113+0000","last_fullsized":"2024-04-25T13:16:27.001113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687821+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:16:26.687821+0000","last_peered":"2024-04-25T13:16:26.687821+0000","last_clean":"2024-04-25T13:16:26.687821+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:16:26.687821+0000","last_undegraded":"2024-04-25T13:16:26.687821+0000","last_fullsized":"2024-04-25T13:16:26.687821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000811+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:16:27.000811+0000","last_peered":"2024-04-25T13:16:27.000811+0000","last_clean":"2024-04-25T13:16:27.000811+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:16:27.000811+0000","last_undegraded":"2024-04-25T13:16:27.000811+0000","last_fullsized":"2024-04-25T13:16:27.000811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687597+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:16:26.687597+0000","last_peered":"2024-04-25T13:16:26.687597+0000","last_clean":"2024-04-25T13:16:26.687597+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:16:26.687597+0000","last_undegraded":"2024-04-25T13:16:26.687597+0000","last_fullsized":"2024-04-25T13:16:26.687597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688301+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:16:26.688301+0000","last_peered":"2024-04-25T13:16:26.688301+0000","last_clean":"2024-04-25T13:16:26.688301+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:16:26.688301+0000","last_undegraded":"2024-04-25T13:16:26.688301+0000","last_fullsized":"2024-04-25T13:16:26.688301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999752+0000","last_change":"2024-04-25T13:16:25.705945+0000","last_active":"2024-04-25T13:16:26.999752+0000","last_peered":"2024-04-25T13:16:26.999752+0000","last_clean":"2024-04-25T13:16:26.999752+0000","last_became_active":"2024-04-25T13:16:25.705550+0000","last_became_peered":"2024-04-25T13:16:25.705550+0000","last_unstale":"2024-04-25T13:16:26.999752+0000","last_undegraded":"2024-04-25T13:16:26.999752+0000","last_fullsized":"2024-04-25T13:16:26.999752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:30.764317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828828+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:16:26.828828+0000","last_peered":"2024-04-25T13:16:26.828828+0000","last_clean":"2024-04-25T13:16:26.828828+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:16:26.828828+0000","last_undegraded":"2024-04-25T13:16:26.828828+0000","last_fullsized":"2024-04-25T13:16:26.828828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687635+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:16:26.687635+0000","last_peered":"2024-04-25T13:16:26.687635+0000","last_clean":"2024-04-25T13:16:26.687635+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:16:26.687635+0000","last_undegraded":"2024-04-25T13:16:26.687635+0000","last_fullsized":"2024-04-25T13:16:26.687635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687173+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:16:26.687173+0000","last_peered":"2024-04-25T13:16:26.687173+0000","last_clean":"2024-04-25T13:16:26.687173+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:16:26.687173+0000","last_undegraded":"2024-04-25T13:16:26.687173+0000","last_fullsized":"2024-04-25T13:16:26.687173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000094+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:16:27.000094+0000","last_peered":"2024-04-25T13:16:27.000094+0000","last_clean":"2024-04-25T13:16:27.000094+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:16:27.000094+0000","last_undegraded":"2024-04-25T13:16:27.000094+0000","last_fullsized":"2024-04-25T13:16:27.000094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828739+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:16:26.828739+0000","last_peered":"2024-04-25T13:16:26.828739+0000","last_clean":"2024-04-25T13:16:26.828739+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:16:26.828739+0000","last_undegraded":"2024-04-25T13:16:26.828739+0000","last_fullsized":"2024-04-25T13:16:26.828739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:25.709047+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:25.708642+0000","last_became_peered":"2024-04-25T13:16:25.708642+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:08:56.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687295+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:16:26.687295+0000","last_peered":"2024-04-25T13:16:26.687295+0000","last_clean":"2024-04-25T13:16:26.687295+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:16:26.687295+0000","last_undegraded":"2024-04-25T13:16:26.687295+0000","last_fullsized":"2024-04-25T13:16:26.687295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999384+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:16:26.999384+0000","last_peered":"2024-04-25T13:16:26.999384+0000","last_clean":"2024-04-25T13:16:26.999384+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:16:26.999384+0000","last_undegraded":"2024-04-25T13:16:26.999384+0000","last_fullsized":"2024-04-25T13:16:26.999384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687946+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:16:26.687946+0000","last_peered":"2024-04-25T13:16:26.687946+0000","last_clean":"2024-04-25T13:16:26.687946+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:16:26.687946+0000","last_undegraded":"2024-04-25T13:16:26.687946+0000","last_fullsized":"2024-04-25T13:16:26.687946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999439+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:16:26.999439+0000","last_peered":"2024-04-25T13:16:26.999439+0000","last_clean":"2024-04-25T13:16:26.999439+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:16:26.999439+0000","last_undegraded":"2024-04-25T13:16:26.999439+0000","last_fullsized":"2024-04-25T13:16:26.999439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000395+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:16:27.000395+0000","last_peered":"2024-04-25T13:16:27.000395+0000","last_clean":"2024-04-25T13:16:27.000395+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:16:27.000395+0000","last_undegraded":"2024-04-25T13:16:27.000395+0000","last_fullsized":"2024-04-25T13:16:27.000395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000037+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:16:27.000037+0000","last_peered":"2024-04-25T13:16:27.000037+0000","last_clean":"2024-04-25T13:16:27.000037+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:16:27.000037+0000","last_undegraded":"2024-04-25T13:16:27.000037+0000","last_fullsized":"2024-04-25T13:16:27.000037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828455+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:16:26.828455+0000","last_peered":"2024-04-25T13:16:26.828455+0000","last_clean":"2024-04-25T13:16:26.828455+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:16:26.828455+0000","last_undegraded":"2024-04-25T13:16:26.828455+0000","last_fullsized":"2024-04-25T13:16:26.828455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687324+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:16:26.687324+0000","last_peered":"2024-04-25T13:16:26.687324+0000","last_clean":"2024-04-25T13:16:26.687324+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:16:26.687324+0000","last_undegraded":"2024-04-25T13:16:26.687324+0000","last_fullsized":"2024-04-25T13:16:26.687324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688261+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:16:26.688261+0000","last_peered":"2024-04-25T13:16:26.688261+0000","last_clean":"2024-04-25T13:16:26.688261+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:16:26.688261+0000","last_undegraded":"2024-04-25T13:16:26.688261+0000","last_fullsized":"2024-04-25T13:16:26.688261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687709+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:16:26.687709+0000","last_peered":"2024-04-25T13:16:26.687709+0000","last_clean":"2024-04-25T13:16:26.687709+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:16:26.687709+0000","last_undegraded":"2024-04-25T13:16:26.687709+0000","last_fullsized":"2024-04-25T13:16:26.687709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000780+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:16:27.000780+0000","last_peered":"2024-04-25T13:16:27.000780+0000","last_clean":"2024-04-25T13:16:27.000780+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:16:27.000780+0000","last_undegraded":"2024-04-25T13:16:27.000780+0000","last_fullsized":"2024-04-25T13:16:27.000780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687526+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:16:26.687526+0000","last_peered":"2024-04-25T13:16:26.687526+0000","last_clean":"2024-04-25T13:16:26.687526+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:16:26.687526+0000","last_undegraded":"2024-04-25T13:16:26.687526+0000","last_fullsized":"2024-04-25T13:16:26.687526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828608+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:16:26.828608+0000","last_peered":"2024-04-25T13:16:26.828608+0000","last_clean":"2024-04-25T13:16:26.828608+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:16:26.828608+0000","last_undegraded":"2024-04-25T13:16:26.828608+0000","last_fullsized":"2024-04-25T13:16:26.828608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687640+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:16:26.687640+0000","last_peered":"2024-04-25T13:16:26.687640+0000","last_clean":"2024-04-25T13:16:26.687640+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:16:26.687640+0000","last_undegraded":"2024-04-25T13:16:26.687640+0000","last_fullsized":"2024-04-25T13:16:26.687640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999890+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:16:26.999890+0000","last_peered":"2024-04-25T13:16:26.999890+0000","last_clean":"2024-04-25T13:16:26.999890+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:16:26.999890+0000","last_undegraded":"2024-04-25T13:16:26.999890+0000","last_fullsized":"2024-04-25T13:16:26.999890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688905+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:16:26.688905+0000","last_peered":"2024-04-25T13:16:26.688905+0000","last_clean":"2024-04-25T13:16:26.688905+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:16:26.688905+0000","last_undegraded":"2024-04-25T13:16:26.688905+0000","last_fullsized":"2024-04-25T13:16:26.688905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999838+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:16:26.999838+0000","last_peered":"2024-04-25T13:16:26.999838+0000","last_clean":"2024-04-25T13:16:26.999838+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:16:26.999838+0000","last_undegraded":"2024-04-25T13:16:26.999838+0000","last_fullsized":"2024-04-25T13:16:26.999838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828257+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:16:26.828257+0000","last_peered":"2024-04-25T13:16:26.828257+0000","last_clean":"2024-04-25T13:16:26.828257+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:16:26.828257+0000","last_undegraded":"2024-04-25T13:16:26.828257+0000","last_fullsized":"2024-04-25T13:16:26.828257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687921+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:16:26.687921+0000","last_peered":"2024-04-25T13:16:26.687921+0000","last_clean":"2024-04-25T13:16:26.687921+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:16:26.687921+0000","last_undegraded":"2024-04-25T13:16:26.687921+0000","last_fullsized":"2024-04-25T13:16:26.687921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000245+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:16:27.000245+0000","last_peered":"2024-04-25T13:16:27.000245+0000","last_clean":"2024-04-25T13:16:27.000245+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:16:27.000245+0000","last_undegraded":"2024-04-25T13:16:27.000245+0000","last_fullsized":"2024-04-25T13:16:27.000245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999436+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:16:26.999436+0000","last_peered":"2024-04-25T13:16:26.999436+0000","last_clean":"2024-04-25T13:16:26.999436+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:16:26.999436+0000","last_undegraded":"2024-04-25T13:16:26.999436+0000","last_fullsized":"2024-04-25T13:16:26.999436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999066+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:16:26.999066+0000","last_peered":"2024-04-25T13:16:26.999066+0000","last_clean":"2024-04-25T13:16:26.999066+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:16:26.999066+0000","last_undegraded":"2024-04-25T13:16:26.999066+0000","last_fullsized":"2024-04-25T13:16:26.999066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000256+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:16:27.000256+0000","last_peered":"2024-04-25T13:16:27.000256+0000","last_clean":"2024-04-25T13:16:27.000256+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:16:27.000256+0000","last_undegraded":"2024-04-25T13:16:27.000256+0000","last_fullsized":"2024-04-25T13:16:27.000256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688254+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:16:26.688254+0000","last_peered":"2024-04-25T13:16:26.688254+0000","last_clean":"2024-04-25T13:16:26.688254+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:16:26.688254+0000","last_undegraded":"2024-04-25T13:16:26.688254+0000","last_fullsized":"2024-04-25T13:16:26.688254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687675+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:16:26.687675+0000","last_peered":"2024-04-25T13:16:26.687675+0000","last_clean":"2024-04-25T13:16:26.687675+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:16:26.687675+0000","last_undegraded":"2024-04-25T13:16:26.687675+0000","last_fullsized":"2024-04-25T13:16:26.687675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001041+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:16:27.001041+0000","last_peered":"2024-04-25T13:16:27.001041+0000","last_clean":"2024-04-25T13:16:27.001041+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:16:27.001041+0000","last_undegraded":"2024-04-25T13:16:27.001041+0000","last_fullsized":"2024-04-25T13:16:27.001041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688112+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:16:26.688112+0000","last_peered":"2024-04-25T13:16:26.688112+0000","last_clean":"2024-04-25T13:16:26.688112+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:16:26.688112+0000","last_undegraded":"2024-04-25T13:16:26.688112+0000","last_fullsized":"2024-04-25T13:16:26.688112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828735+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:16:26.828735+0000","last_peered":"2024-04-25T13:16:26.828735+0000","last_clean":"2024-04-25T13:16:26.828735+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:16:26.828735+0000","last_undegraded":"2024-04-25T13:16:26.828735+0000","last_fullsized":"2024-04-25T13:16:26.828735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000341+0000","last_change":"2024-04-25T13:16:25.709677+0000","last_active":"2024-04-25T13:16:27.000341+0000","last_peered":"2024-04-25T13:16:27.000341+0000","last_clean":"2024-04-25T13:16:27.000341+0000","last_became_active":"2024-04-25T13:16:25.707247+0000","last_became_peered":"2024-04-25T13:16:25.707247+0000","last_unstale":"2024-04-25T13:16:27.000341+0000","last_undegraded":"2024-04-25T13:16:27.000341+0000","last_fullsized":"2024-04-25T13:16:27.000341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:37.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999611+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:16:26.999611+0000","last_peered":"2024-04-25T13:16:26.999611+0000","last_clean":"2024-04-25T13:16:26.999611+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:16:26.999611+0000","last_undegraded":"2024-04-25T13:16:26.999611+0000","last_fullsized":"2024-04-25T13:16:26.999611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999938+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:16:26.999938+0000","last_peered":"2024-04-25T13:16:26.999938+0000","last_clean":"2024-04-25T13:16:26.999938+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:16:26.999938+0000","last_undegraded":"2024-04-25T13:16:26.999938+0000","last_fullsized":"2024-04-25T13:16:26.999938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828759+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:16:26.828759+0000","last_peered":"2024-04-25T13:16:26.828759+0000","last_clean":"2024-04-25T13:16:26.828759+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:16:26.828759+0000","last_undegraded":"2024-04-25T13:16:26.828759+0000","last_fullsized":"2024-04-25T13:16:26.828759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687616+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:16:26.687616+0000","last_peered":"2024-04-25T13:16:26.687616+0000","last_clean":"2024-04-25T13:16:26.687616+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:16:26.687616+0000","last_undegraded":"2024-04-25T13:16:26.687616+0000","last_fullsized":"2024-04-25T13:16:26.687616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:36.096330+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:16:36.096330+0000","last_peered":"2024-04-25T13:16:36.096330+0000","last_clean":"2024-04-25T13:16:36.096330+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:16:36.096330+0000","last_undegraded":"2024-04-25T13:16:36.096330+0000","last_fullsized":"2024-04-25T13:16:36.096330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687301+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:16:26.687301+0000","last_peered":"2024-04-25T13:16:26.687301+0000","last_clean":"2024-04-25T13:16:26.687301+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:16:26.687301+0000","last_undegraded":"2024-04-25T13:16:26.687301+0000","last_fullsized":"2024-04-25T13:16:26.687301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999970+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:16:26.999970+0000","last_peered":"2024-04-25T13:16:26.999970+0000","last_clean":"2024-04-25T13:16:26.999970+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:16:26.999970+0000","last_undegraded":"2024-04-25T13:16:26.999970+0000","last_fullsized":"2024-04-25T13:16:26.999970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687595+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:16:26.687595+0000","last_peered":"2024-04-25T13:16:26.687595+0000","last_clean":"2024-04-25T13:16:26.687595+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:16:26.687595+0000","last_undegraded":"2024-04-25T13:16:26.687595+0000","last_fullsized":"2024-04-25T13:16:26.687595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999908+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:16:26.999908+0000","last_peered":"2024-04-25T13:16:26.999908+0000","last_clean":"2024-04-25T13:16:26.999908+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:16:26.999908+0000","last_undegraded":"2024-04-25T13:16:26.999908+0000","last_fullsized":"2024-04-25T13:16:26.999908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000683+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:16:27.000683+0000","last_peered":"2024-04-25T13:16:27.000683+0000","last_clean":"2024-04-25T13:16:27.000683+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:16:27.000683+0000","last_undegraded":"2024-04-25T13:16:27.000683+0000","last_fullsized":"2024-04-25T13:16:27.000683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828848+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:16:26.828848+0000","last_peered":"2024-04-25T13:16:26.828848+0000","last_clean":"2024-04-25T13:16:26.828848+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:16:26.828848+0000","last_undegraded":"2024-04-25T13:16:26.828848+0000","last_fullsized":"2024-04-25T13:16:26.828848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001032+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:16:27.001032+0000","last_peered":"2024-04-25T13:16:27.001032+0000","last_clean":"2024-04-25T13:16:27.001032+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:16:27.001032+0000","last_undegraded":"2024-04-25T13:16:27.001032+0000","last_fullsized":"2024-04-25T13:16:27.001032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828856+0000","last_change":"2024-04-25T13:16:21.665570+0000","last_active":"2024-04-25T13:16:26.828856+0000","last_peered":"2024-04-25T13:16:26.828856+0000","last_clean":"2024-04-25T13:16:26.828856+0000","last_became_active":"2024-04-25T13:16:21.665168+0000","last_became_peered":"2024-04-25T13:16:21.665168+0000","last_unstale":"2024-04-25T13:16:26.828856+0000","last_undegraded":"2024-04-25T13:16:26.828856+0000","last_fullsized":"2024-04-25T13:16:26.828856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:10.029372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688617+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:16:26.688617+0000","last_peered":"2024-04-25T13:16:26.688617+0000","last_clean":"2024-04-25T13:16:26.688617+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:16:26.688617+0000","last_undegraded":"2024-04-25T13:16:26.688617+0000","last_fullsized":"2024-04-25T13:16:26.688617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000409+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:16:27.000409+0000","last_peered":"2024-04-25T13:16:27.000409+0000","last_clean":"2024-04-25T13:16:27.000409+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:16:27.000409+0000","last_undegraded":"2024-04-25T13:16:27.000409+0000","last_fullsized":"2024-04-25T13:16:27.000409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000112+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:16:27.000112+0000","last_peered":"2024-04-25T13:16:27.000112+0000","last_clean":"2024-04-25T13:16:27.000112+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:16:27.000112+0000","last_undegraded":"2024-04-25T13:16:27.000112+0000","last_fullsized":"2024-04-25T13:16:27.000112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687005+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:16:26.687005+0000","last_peered":"2024-04-25T13:16:26.687005+0000","last_clean":"2024-04-25T13:16:26.687005+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:16:26.687005+0000","last_undegraded":"2024-04-25T13:16:26.687005+0000","last_fullsized":"2024-04-25T13:16:26.687005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828401+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:16:26.828401+0000","last_peered":"2024-04-25T13:16:26.828401+0000","last_clean":"2024-04-25T13:16:26.828401+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:16:26.828401+0000","last_undegraded":"2024-04-25T13:16:26.828401+0000","last_fullsized":"2024-04-25T13:16:26.828401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688528+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:16:26.688528+0000","last_peered":"2024-04-25T13:16:26.688528+0000","last_clean":"2024-04-25T13:16:26.688528+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:16:26.688528+0000","last_undegraded":"2024-04-25T13:16:26.688528+0000","last_fullsized":"2024-04-25T13:16:26.688528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001000+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:16:27.001000+0000","last_peered":"2024-04-25T13:16:27.001000+0000","last_clean":"2024-04-25T13:16:27.001000+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:16:27.001000+0000","last_undegraded":"2024-04-25T13:16:27.001000+0000","last_fullsized":"2024-04-25T13:16:27.001000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000623+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:16:27.000623+0000","last_peered":"2024-04-25T13:16:27.000623+0000","last_clean":"2024-04-25T13:16:27.000623+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:16:27.000623+0000","last_undegraded":"2024-04-25T13:16:27.000623+0000","last_fullsized":"2024-04-25T13:16:27.000623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688455+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:16:26.688455+0000","last_peered":"2024-04-25T13:16:26.688455+0000","last_clean":"2024-04-25T13:16:26.688455+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:16:26.688455+0000","last_undegraded":"2024-04-25T13:16:26.688455+0000","last_fullsized":"2024-04-25T13:16:26.688455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999914+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:16:26.999914+0000","last_peered":"2024-04-25T13:16:26.999914+0000","last_clean":"2024-04-25T13:16:26.999914+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:16:26.999914+0000","last_undegraded":"2024-04-25T13:16:26.999914+0000","last_fullsized":"2024-04-25T13:16:26.999914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999479+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:16:26.999479+0000","last_peered":"2024-04-25T13:16:26.999479+0000","last_clean":"2024-04-25T13:16:26.999479+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:16:26.999479+0000","last_undegraded":"2024-04-25T13:16:26.999479+0000","last_fullsized":"2024-04-25T13:16:26.999479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000587+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:16:27.000587+0000","last_peered":"2024-04-25T13:16:27.000587+0000","last_clean":"2024-04-25T13:16:27.000587+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:16:27.000587+0000","last_undegraded":"2024-04-25T13:16:27.000587+0000","last_fullsized":"2024-04-25T13:16:27.000587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999648+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:16:26.999648+0000","last_peered":"2024-04-25T13:16:26.999648+0000","last_clean":"2024-04-25T13:16:26.999648+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:16:26.999648+0000","last_undegraded":"2024-04-25T13:16:26.999648+0000","last_fullsized":"2024-04-25T13:16:26.999648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000307+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:16:27.000307+0000","last_peered":"2024-04-25T13:16:27.000307+0000","last_clean":"2024-04-25T13:16:27.000307+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:16:27.000307+0000","last_undegraded":"2024-04-25T13:16:27.000307+0000","last_fullsized":"2024-04-25T13:16:27.000307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687291+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:16:26.687291+0000","last_peered":"2024-04-25T13:16:26.687291+0000","last_clean":"2024-04-25T13:16:26.687291+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:16:26.687291+0000","last_undegraded":"2024-04-25T13:16:26.687291+0000","last_fullsized":"2024-04-25T13:16:26.687291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999304+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:16:26.999304+0000","last_peered":"2024-04-25T13:16:26.999304+0000","last_clean":"2024-04-25T13:16:26.999304+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:16:26.999304+0000","last_undegraded":"2024-04-25T13:16:26.999304+0000","last_fullsized":"2024-04-25T13:16:26.999304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828575+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:16:26.828575+0000","last_peered":"2024-04-25T13:16:26.828575+0000","last_clean":"2024-04-25T13:16:26.828575+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:16:26.828575+0000","last_undegraded":"2024-04-25T13:16:26.828575+0000","last_fullsized":"2024-04-25T13:16:26.828575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999830+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:16:26.999830+0000","last_peered":"2024-04-25T13:16:26.999830+0000","last_clean":"2024-04-25T13:16:26.999830+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:16:26.999830+0000","last_undegraded":"2024-04-25T13:16:26.999830+0000","last_fullsized":"2024-04-25T13:16:26.999830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688587+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:16:26.688587+0000","last_peered":"2024-04-25T13:16:26.688587+0000","last_clean":"2024-04-25T13:16:26.688587+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:16:26.688587+0000","last_undegraded":"2024-04-25T13:16:26.688587+0000","last_fullsized":"2024-04-25T13:16:26.688587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001087+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:16:27.001087+0000","last_peered":"2024-04-25T13:16:27.001087+0000","last_clean":"2024-04-25T13:16:27.001087+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:16:27.001087+0000","last_undegraded":"2024-04-25T13:16:27.001087+0000","last_fullsized":"2024-04-25T13:16:27.001087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828304+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:16:26.828304+0000","last_peered":"2024-04-25T13:16:26.828304+0000","last_clean":"2024-04-25T13:16:26.828304+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:16:26.828304+0000","last_undegraded":"2024-04-25T13:16:26.828304+0000","last_fullsized":"2024-04-25T13:16:26.828304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000461+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:16:27.000461+0000","last_peered":"2024-04-25T13:16:27.000461+0000","last_clean":"2024-04-25T13:16:27.000461+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:16:27.000461+0000","last_undegraded":"2024-04-25T13:16:27.000461+0000","last_fullsized":"2024-04-25T13:16:27.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828566+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:16:26.828566+0000","last_peered":"2024-04-25T13:16:26.828566+0000","last_clean":"2024-04-25T13:16:26.828566+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:16:26.828566+0000","last_undegraded":"2024-04-25T13:16:26.828566+0000","last_fullsized":"2024-04-25T13:16:26.828566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999722+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:16:26.999722+0000","last_peered":"2024-04-25T13:16:26.999722+0000","last_clean":"2024-04-25T13:16:26.999722+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:16:26.999722+0000","last_undegraded":"2024-04-25T13:16:26.999722+0000","last_fullsized":"2024-04-25T13:16:26.999722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688999+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:16:26.688999+0000","last_peered":"2024-04-25T13:16:26.688999+0000","last_clean":"2024-04-25T13:16:26.688999+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:16:26.688999+0000","last_undegraded":"2024-04-25T13:16:26.688999+0000","last_fullsized":"2024-04-25T13:16:26.688999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688200+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:16:26.688200+0000","last_peered":"2024-04-25T13:16:26.688200+0000","last_clean":"2024-04-25T13:16:26.688200+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:16:26.688200+0000","last_undegraded":"2024-04-25T13:16:26.688200+0000","last_fullsized":"2024-04-25T13:16:26.688200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999798+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:16:26.999798+0000","last_peered":"2024-04-25T13:16:26.999798+0000","last_clean":"2024-04-25T13:16:26.999798+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:26.999798+0000","last_undegraded":"2024-04-25T13:16:26.999798+0000","last_fullsized":"2024-04-25T13:16:26.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828947+0000","last_change":"2024-04-25T13:16:21.666904+0000","last_active":"2024-04-25T13:16:26.828947+0000","last_peered":"2024-04-25T13:16:26.828947+0000","last_clean":"2024-04-25T13:16:26.828947+0000","last_became_active":"2024-04-25T13:16:21.666638+0000","last_became_peered":"2024-04-25T13:16:21.666638+0000","last_unstale":"2024-04-25T13:16:26.828947+0000","last_undegraded":"2024-04-25T13:16:26.828947+0000","last_fullsized":"2024-04-25T13:16:26.828947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:54.740696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828197+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:16:26.828197+0000","last_peered":"2024-04-25T13:16:26.828197+0000","last_clean":"2024-04-25T13:16:26.828197+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:16:26.828197+0000","last_undegraded":"2024-04-25T13:16:26.828197+0000","last_fullsized":"2024-04-25T13:16:26.828197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687381+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:16:26.687381+0000","last_peered":"2024-04-25T13:16:26.687381+0000","last_clean":"2024-04-25T13:16:26.687381+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:16:26.687381+0000","last_undegraded":"2024-04-25T13:16:26.687381+0000","last_fullsized":"2024-04-25T13:16:26.687381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999585+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:16:26.999585+0000","last_peered":"2024-04-25T13:16:26.999585+0000","last_clean":"2024-04-25T13:16:26.999585+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:16:26.999585+0000","last_undegraded":"2024-04-25T13:16:26.999585+0000","last_fullsized":"2024-04-25T13:16:26.999585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000418+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:16:27.000418+0000","last_peered":"2024-04-25T13:16:27.000418+0000","last_clean":"2024-04-25T13:16:27.000418+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:27.000418+0000","last_undegraded":"2024-04-25T13:16:27.000418+0000","last_fullsized":"2024-04-25T13:16:27.000418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999907+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:16:26.999907+0000","last_peered":"2024-04-25T13:16:26.999907+0000","last_clean":"2024-04-25T13:16:26.999907+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:16:26.999907+0000","last_undegraded":"2024-04-25T13:16:26.999907+0000","last_fullsized":"2024-04-25T13:16:26.999907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688332+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:16:26.688332+0000","last_peered":"2024-04-25T13:16:26.688332+0000","last_clean":"2024-04-25T13:16:26.688332+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:16:26.688332+0000","last_undegraded":"2024-04-25T13:16:26.688332+0000","last_fullsized":"2024-04-25T13:16:26.688332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688469+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:16:26.688469+0000","last_peered":"2024-04-25T13:16:26.688469+0000","last_clean":"2024-04-25T13:16:26.688469+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:16:26.688469+0000","last_undegraded":"2024-04-25T13:16:26.688469+0000","last_fullsized":"2024-04-25T13:16:26.688469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688862+0000","last_change":"2024-04-25T13:16:21.665463+0000","last_active":"2024-04-25T13:16:26.688862+0000","last_peered":"2024-04-25T13:16:26.688862+0000","last_clean":"2024-04-25T13:16:26.688862+0000","last_became_active":"2024-04-25T13:16:21.665120+0000","last_became_peered":"2024-04-25T13:16:21.665120+0000","last_unstale":"2024-04-25T13:16:26.688862+0000","last_undegraded":"2024-04-25T13:16:26.688862+0000","last_fullsized":"2024-04-25T13:16:26.688862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:33.552291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000878+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:16:27.000878+0000","last_peered":"2024-04-25T13:16:27.000878+0000","last_clean":"2024-04-25T13:16:27.000878+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:16:27.000878+0000","last_undegraded":"2024-04-25T13:16:27.000878+0000","last_fullsized":"2024-04-25T13:16:27.000878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687369+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:16:26.687369+0000","last_peered":"2024-04-25T13:16:26.687369+0000","last_clean":"2024-04-25T13:16:26.687369+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:16:26.687369+0000","last_undegraded":"2024-04-25T13:16:26.687369+0000","last_fullsized":"2024-04-25T13:16:26.687369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828382+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:16:26.828382+0000","last_peered":"2024-04-25T13:16:26.828382+0000","last_clean":"2024-04-25T13:16:26.828382+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:16:26.828382+0000","last_undegraded":"2024-04-25T13:16:26.828382+0000","last_fullsized":"2024-04-25T13:16:26.828382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687907+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:16:26.687907+0000","last_peered":"2024-04-25T13:16:26.687907+0000","last_clean":"2024-04-25T13:16:26.687907+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:16:26.687907+0000","last_undegraded":"2024-04-25T13:16:26.687907+0000","last_fullsized":"2024-04-25T13:16:26.687907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828456+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:16:26.828456+0000","last_peered":"2024-04-25T13:16:26.828456+0000","last_clean":"2024-04-25T13:16:26.828456+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:16:26.828456+0000","last_undegraded":"2024-04-25T13:16:26.828456+0000","last_fullsized":"2024-04-25T13:16:26.828456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999773+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:16:26.999773+0000","last_peered":"2024-04-25T13:16:26.999773+0000","last_clean":"2024-04-25T13:16:26.999773+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:16:26.999773+0000","last_undegraded":"2024-04-25T13:16:26.999773+0000","last_fullsized":"2024-04-25T13:16:26.999773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687734+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:16:26.687734+0000","last_peered":"2024-04-25T13:16:26.687734+0000","last_clean":"2024-04-25T13:16:26.687734+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:16:26.687734+0000","last_undegraded":"2024-04-25T13:16:26.687734+0000","last_fullsized":"2024-04-25T13:16:26.687734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688481+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:16:26.688481+0000","last_peered":"2024-04-25T13:16:26.688481+0000","last_clean":"2024-04-25T13:16:26.688481+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:16:26.688481+0000","last_undegraded":"2024-04-25T13:16:26.688481+0000","last_fullsized":"2024-04-25T13:16:26.688481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:54.403 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:16:54.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.537+0000 7f289a5e2640 1 Processor -- start 2024-04-25T13:16:54.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.537+0000 7f289a5e2640 1 -- start start 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f289a5e2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f2894075850 0x7f2894074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f289a5e2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28940ce320 con 0x7f28940cdde0 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f289a5e2640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f289415e4e0 con 0x7f2894144420 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f289a5e2640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f289415e7c0 con 0x7f2894075850 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f2898b7f640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f28940cdde0 0x7f289415c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36262/0 (socket says 172.21.15.155:36262) 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f2898b7f640 1 -- 172.21.15.155:0/2832366090 learned_addr learned my addr 172.21.15.155:0/2832366090 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.538+0000 7f28937fe640 1 --2- 172.21.15.155:0/2832366090 >> v2:172.21.15.191:3300/0 conn(0x7f2894075850 0x7f2894074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.539+0000 7f28937fe640 1 -- 172.21.15.155:0/2832366090 >> v1:172.21.15.191:6789/0 conn(0x7f2894144420 legacy=0x7f289415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.539+0000 7f28937fe640 1 -- 172.21.15.155:0/2832366090 >> v1:172.21.15.155:6789/0 conn(0x7f28940cdde0 legacy=0x7f289415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.539+0000 7f2892ffd640 1 -- 172.21.15.155:0/2832366090 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781764899 0 0) 0x7f28940ce320 con 0x7f28940cdde0 2024-04-25T13:16:54.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.539+0000 7f28937fe640 1 -- 172.21.15.155:0/2832366090 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289415eaa0 con 0x7f2894075850 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.539+0000 7f28937fe640 1 --2- 172.21.15.155:0/2832366090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894075850 0x7f2894074d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28880097a0 tx=0x7f288802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92e37109d8992d1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.539+0000 7f2892ffd640 1 -- 172.21.15.155:0/2832366090 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888037070 con 0x7f2894075850 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f2892ffd640 1 -- 172.21.15.155:0/2832366090 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2888032440 con 0x7f2894075850 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f2892ffd640 1 -- 172.21.15.155:0/2832366090 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888032810 con 0x7f2894075850 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 -- 172.21.15.155:0/2832366090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894075850 msgr2=0x7f2894074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 --2- 172.21.15.155:0/2832366090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894075850 0x7f2894074d50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f28880097a0 tx=0x7f288802a230 comp rx=0 tx=0).stop 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 -- 172.21.15.155:0/2832366090 shutdown_connections 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 --2- 172.21.15.155:0/2832366090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894075850 0x7f2894074d50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 -- 172.21.15.155:0/2832366090 >> 172.21.15.155:0/2832366090 conn(0x7f289406b920 msgr2=0x7f289406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 -- 172.21.15.155:0/2832366090 shutdown_connections 2024-04-25T13:16:54.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.540+0000 7f289a5e2640 1 -- 172.21.15.155:0/2832366090 wait complete. 2024-04-25T13:16:54.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.541+0000 7f289a5e2640 1 Processor -- start 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.541+0000 7f289a5e2640 1 -- start start 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f289a5e2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2894075850 0x7f28940c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f289a5e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 0x7f28940cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f289a5e2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894144420 0x7f2894158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f289a5e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f289415cc70 con 0x7f28940cdde0 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f289a5e2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f289415caf0 con 0x7f2894144420 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f289a5e2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f2894075290 con 0x7f2894075850 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 0x7f28940cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 0x7f28940cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54820/0 (socket says 172.21.15.155:54820) 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 -- 172.21.15.155:0/1973647704 learned_addr learned my addr 172.21.15.155:0/1973647704 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f2898b7f640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894144420 0x7f2894158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f2893fff640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2894075850 0x7f28940c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 -- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2894075850 msgr2=0x7f28940c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2894075850 0x7f28940c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 -- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894144420 msgr2=0x7f2894158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894144420 0x7f2894158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.542+0000 7f28937fe640 1 -- 172.21.15.155:0/1973647704 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28940c4f80 con 0x7f28940cdde0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.543+0000 7f28937fe640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 0x7f28940cc620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2888035040 tx=0x7f28880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.543+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888037050 con 0x7f28940cdde0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.543+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2888038040 con 0x7f28940cdde0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.543+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28941f1080 con 0x7f28940cdde0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.543+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888004490 con 0x7f28940cdde0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.543+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28941f1640 con 0x7f28940cdde0 2024-04-25T13:16:54.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.544+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2894068e40 con 0x7f28940cdde0 2024-04-25T13:16:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.544+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2888030900 con 0x7f28940cdde0 2024-04-25T13:16:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.545+0000 7f2890ff9640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288006c8f0 0x7f288006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.545+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f28880ac930 con 0x7f28940cdde0 2024-04-25T13:16:54.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.545+0000 7f2893fff640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288006c8f0 0x7f288006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.545+0000 7f2893fff640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288006c8f0 0x7f288006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2884000f60 tx=0x7f2884009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.549+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f288807a4f0 con 0x7f28940cdde0 2024-04-25T13:16:54.722 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.722+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f289415de00 con 0x7f288006c8f0 2024-04-25T13:16:54.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.729+0000 7f2890ff9640 1 -- 172.21.15.155:0/1973647704 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f289415de00 con 0x7f288006c8f0 2024-04-25T13:16:54.733 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:54.735 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.732+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288006c8f0 msgr2=0x7f288006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.732+0000 7f289a5e2640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288006c8f0 0x7f288006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2884000f60 tx=0x7f2884009040 comp rx=0 tx=0).stop 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.732+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 msgr2=0x7f28940cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.732+0000 7f289a5e2640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 0x7f28940cc620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2888035040 tx=0x7f28880046c0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 shutdown_connections 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2894144420 0x7f2894158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28940cdde0 0x7f28940cc620 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f288006c8f0 0x7f288006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 --2- 172.21.15.155:0/1973647704 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f2894075850 0x7f28940c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 >> 172.21.15.155:0/1973647704 conn(0x7f289406b920 msgr2=0x7f289406fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 shutdown_connections 2024-04-25T13:16:54.738 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.733+0000 7f289a5e2640 1 -- 172.21.15.155:0/1973647704 wait complete. 2024-04-25T13:16:54.743 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T13:16:53.623336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219472,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755248,"statfs":{"total":773094113280,"available":772869373952,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002937"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000719+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:16:27.000719+0000","last_peered":"2024-04-25T13:16:27.000719+0000","last_clean":"2024-04-25T13:16:27.000719+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:16:27.000719+0000","last_undegraded":"2024-04-25T13:16:27.000719+0000","last_fullsized":"2024-04-25T13:16:27.000719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000852+0000","last_change":"2024-04-25T13:16:21.677923+0000","last_active":"2024-04-25T13:16:27.000852+0000","last_peered":"2024-04-25T13:16:27.000852+0000","last_clean":"2024-04-25T13:16:27.000852+0000","last_became_active":"2024-04-25T13:16:21.676720+0000","last_became_peered":"2024-04-25T13:16:21.676720+0000","last_unstale":"2024-04-25T13:16:27.000852+0000","last_undegraded":"2024-04-25T13:16:27.000852+0000","last_fullsized":"2024-04-25T13:16:27.000852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:31.190458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000250+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:16:27.000250+0000","last_peered":"2024-04-25T13:16:27.000250+0000","last_clean":"2024-04-25T13:16:27.000250+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:16:27.000250+0000","last_undegraded":"2024-04-25T13:16:27.000250+0000","last_fullsized":"2024-04-25T13:16:27.000250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001016+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:16:27.001016+0000","last_peered":"2024-04-25T13:16:27.001016+0000","last_clean":"2024-04-25T13:16:27.001016+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:16:27.001016+0000","last_undegraded":"2024-04-25T13:16:27.001016+0000","last_fullsized":"2024-04-25T13:16:27.001016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000593+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:16:27.000593+0000","last_peered":"2024-04-25T13:16:27.000593+0000","last_clean":"2024-04-25T13:16:27.000593+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:16:27.000593+0000","last_undegraded":"2024-04-25T13:16:27.000593+0000","last_fullsized":"2024-04-25T13:16:27.000593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999478+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:16:26.999478+0000","last_peered":"2024-04-25T13:16:26.999478+0000","last_clean":"2024-04-25T13:16:26.999478+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:16:26.999478+0000","last_undegraded":"2024-04-25T13:16:26.999478+0000","last_fullsized":"2024-04-25T13:16:26.999478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687893+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:16:26.687893+0000","last_peered":"2024-04-25T13:16:26.687893+0000","last_clean":"2024-04-25T13:16:26.687893+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:16:26.687893+0000","last_undegraded":"2024-04-25T13:16:26.687893+0000","last_fullsized":"2024-04-25T13:16:26.687893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828472+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:16:26.828472+0000","last_peered":"2024-04-25T13:16:26.828472+0000","last_clean":"2024-04-25T13:16:26.828472+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:16:26.828472+0000","last_undegraded":"2024-04-25T13:16:26.828472+0000","last_fullsized":"2024-04-25T13:16:26.828472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000162+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:16:27.000162+0000","last_peered":"2024-04-25T13:16:27.000162+0000","last_clean":"2024-04-25T13:16:27.000162+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:16:27.000162+0000","last_undegraded":"2024-04-25T13:16:27.000162+0000","last_fullsized":"2024-04-25T13:16:27.000162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688119+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:16:26.688119+0000","last_peered":"2024-04-25T13:16:26.688119+0000","last_clean":"2024-04-25T13:16:26.688119+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:16:26.688119+0000","last_undegraded":"2024-04-25T13:16:26.688119+0000","last_fullsized":"2024-04-25T13:16:26.688119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828686+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:16:26.828686+0000","last_peered":"2024-04-25T13:16:26.828686+0000","last_clean":"2024-04-25T13:16:26.828686+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:16:26.828686+0000","last_undegraded":"2024-04-25T13:16:26.828686+0000","last_fullsized":"2024-04-25T13:16:26.828686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999572+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:16:26.999572+0000","last_peered":"2024-04-25T13:16:26.999572+0000","last_clean":"2024-04-25T13:16:26.999572+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:16:26.999572+0000","last_undegraded":"2024-04-25T13:16:26.999572+0000","last_fullsized":"2024-04-25T13:16:26.999572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688207+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:16:26.688207+0000","last_peered":"2024-04-25T13:16:26.688207+0000","last_clean":"2024-04-25T13:16:26.688207+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:16:26.688207+0000","last_undegraded":"2024-04-25T13:16:26.688207+0000","last_fullsized":"2024-04-25T13:16:26.688207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000138+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:16:27.000138+0000","last_peered":"2024-04-25T13:16:27.000138+0000","last_clean":"2024-04-25T13:16:27.000138+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:16:27.000138+0000","last_undegraded":"2024-04-25T13:16:27.000138+0000","last_fullsized":"2024-04-25T13:16:27.000138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000505+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:16:27.000505+0000","last_peered":"2024-04-25T13:16:27.000505+0000","last_clean":"2024-04-25T13:16:27.000505+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:16:27.000505+0000","last_undegraded":"2024-04-25T13:16:27.000505+0000","last_fullsized":"2024-04-25T13:16:27.000505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687372+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:16:26.687372+0000","last_peered":"2024-04-25T13:16:26.687372+0000","last_clean":"2024-04-25T13:16:26.687372+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:16:26.687372+0000","last_undegraded":"2024-04-25T13:16:26.687372+0000","last_fullsized":"2024-04-25T13:16:26.687372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999884+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:16:26.999884+0000","last_peered":"2024-04-25T13:16:26.999884+0000","last_clean":"2024-04-25T13:16:26.999884+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:16:26.999884+0000","last_undegraded":"2024-04-25T13:16:26.999884+0000","last_fullsized":"2024-04-25T13:16:26.999884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001079+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:16:27.001079+0000","last_peered":"2024-04-25T13:16:27.001079+0000","last_clean":"2024-04-25T13:16:27.001079+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:16:27.001079+0000","last_undegraded":"2024-04-25T13:16:27.001079+0000","last_fullsized":"2024-04-25T13:16:27.001079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687469+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:16:26.687469+0000","last_peered":"2024-04-25T13:16:26.687469+0000","last_clean":"2024-04-25T13:16:26.687469+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:16:26.687469+0000","last_undegraded":"2024-04-25T13:16:26.687469+0000","last_fullsized":"2024-04-25T13:16:26.687469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687887+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:16:26.687887+0000","last_peered":"2024-04-25T13:16:26.687887+0000","last_clean":"2024-04-25T13:16:26.687887+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:16:26.687887+0000","last_undegraded":"2024-04-25T13:16:26.687887+0000","last_fullsized":"2024-04-25T13:16:26.687887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999794+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:16:26.999794+0000","last_peered":"2024-04-25T13:16:26.999794+0000","last_clean":"2024-04-25T13:16:26.999794+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:16:26.999794+0000","last_undegraded":"2024-04-25T13:16:26.999794+0000","last_fullsized":"2024-04-25T13:16:26.999794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000168+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:16:27.000168+0000","last_peered":"2024-04-25T13:16:27.000168+0000","last_clean":"2024-04-25T13:16:27.000168+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:16:27.000168+0000","last_undegraded":"2024-04-25T13:16:27.000168+0000","last_fullsized":"2024-04-25T13:16:27.000168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.689047+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:16:26.689047+0000","last_peered":"2024-04-25T13:16:26.689047+0000","last_clean":"2024-04-25T13:16:26.689047+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:16:26.689047+0000","last_undegraded":"2024-04-25T13:16:26.689047+0000","last_fullsized":"2024-04-25T13:16:26.689047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999769+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:16:26.999769+0000","last_peered":"2024-04-25T13:16:26.999769+0000","last_clean":"2024-04-25T13:16:26.999769+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:16:26.999769+0000","last_undegraded":"2024-04-25T13:16:26.999769+0000","last_fullsized":"2024-04-25T13:16:26.999769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001113+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:16:27.001113+0000","last_peered":"2024-04-25T13:16:27.001113+0000","last_clean":"2024-04-25T13:16:27.001113+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:16:27.001113+0000","last_undegraded":"2024-04-25T13:16:27.001113+0000","last_fullsized":"2024-04-25T13:16:27.001113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687821+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:16:26.687821+0000","last_peered":"2024-04-25T13:16:26.687821+0000","last_clean":"2024-04-25T13:16:26.687821+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:16:26.687821+0000","last_undegraded":"2024-04-25T13:16:26.687821+0000","last_fullsized":"2024-04-25T13:16:26.687821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000811+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:16:27.000811+0000","last_peered":"2024-04-25T13:16:27.000811+0000","last_clean":"2024-04-25T13:16:27.000811+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:16:27.000811+0000","last_undegraded":"2024-04-25T13:16:27.000811+0000","last_fullsized":"2024-04-25T13:16:27.000811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687597+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:16:26.687597+0000","last_peered":"2024-04-25T13:16:26.687597+0000","last_clean":"2024-04-25T13:16:26.687597+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:16:26.687597+0000","last_undegraded":"2024-04-25T13:16:26.687597+0000","last_fullsized":"2024-04-25T13:16:26.687597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688301+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:16:26.688301+0000","last_peered":"2024-04-25T13:16:26.688301+0000","last_clean":"2024-04-25T13:16:26.688301+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:16:26.688301+0000","last_undegraded":"2024-04-25T13:16:26.688301+0000","last_fullsized":"2024-04-25T13:16:26.688301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999752+0000","last_change":"2024-04-25T13:16:25.705945+0000","last_active":"2024-04-25T13:16:26.999752+0000","last_peered":"2024-04-25T13:16:26.999752+0000","last_clean":"2024-04-25T13:16:26.999752+0000","last_became_active":"2024-04-25T13:16:25.705550+0000","last_became_peered":"2024-04-25T13:16:25.705550+0000","last_unstale":"2024-04-25T13:16:26.999752+0000","last_undegraded":"2024-04-25T13:16:26.999752+0000","last_fullsized":"2024-04-25T13:16:26.999752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:30.764317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828828+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:16:26.828828+0000","last_peered":"2024-04-25T13:16:26.828828+0000","last_clean":"2024-04-25T13:16:26.828828+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:16:26.828828+0000","last_undegraded":"2024-04-25T13:16:26.828828+0000","last_fullsized":"2024-04-25T13:16:26.828828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687635+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:16:26.687635+0000","last_peered":"2024-04-25T13:16:26.687635+0000","last_clean":"2024-04-25T13:16:26.687635+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:16:26.687635+0000","last_undegraded":"2024-04-25T13:16:26.687635+0000","last_fullsized":"2024-04-25T13:16:26.687635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687173+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:16:26.687173+0000","last_peered":"2024-04-25T13:16:26.687173+0000","last_clean":"2024-04-25T13:16:26.687173+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:16:26.687173+0000","last_undegraded":"2024-04-25T13:16:26.687173+0000","last_fullsized":"2024-04-25T13:16:26.687173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000094+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:16:27.000094+0000","last_peered":"2024-04-25T13:16:27.000094+0000","last_clean":"2024-04-25T13:16:27.000094+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:16:27.000094+0000","last_undegraded":"2024-04-25T13:16:27.000094+0000","last_fullsized":"2024-04-25T13:16:27.000094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828739+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:16:26.828739+0000","last_peered":"2024-04-25T13:16:26.828739+0000","last_clean":"2024-04-25T13:16:26.828739+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:16:26.828739+0000","last_undegraded":"2024-04-25T13:16:26.828739+0000","last_fullsized":"2024-04-25T13:16:26.828739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687582+0000","last_change":"2024-04-25T13:16:25.709047+0000","last_active":"2024-04-25T13:16:26.687582+0000","last_peered":"2024-04-25T13:16:26.687582+0000","last_clean":"2024-04-25T13:16:26.687582+0000","last_became_active":"2024-04-25T13:16:25.708642+0000","last_became_peered":"2024-04-25T13:16:25.708642+0000","last_unstale":"2024-04-25T13:16:26.687582+0000","last_undegraded":"2024-04-25T13:16:26.687582+0000","last_fullsized":"2024-04-25T13:16:26.687582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:08:56.793843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687295+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:16:26.687295+0000","last_peered":"2024-04-25T13:16:26.687295+0000","last_clean":"2024-04-25T13:16:26.687295+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:16:26.687295+0000","last_undegraded":"2024-04-25T13:16:26.687295+0000","last_fullsized":"2024-04-25T13:16:26.687295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999384+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:16:26.999384+0000","last_peered":"2024-04-25T13:16:26.999384+0000","last_clean":"2024-04-25T13:16:26.999384+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:16:26.999384+0000","last_undegraded":"2024-04-25T13:16:26.999384+0000","last_fullsized":"2024-04-25T13:16:26.999384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687946+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:16:26.687946+0000","last_peered":"2024-04-25T13:16:26.687946+0000","last_clean":"2024-04-25T13:16:26.687946+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:16:26.687946+0000","last_undegraded":"2024-04-25T13:16:26.687946+0000","last_fullsized":"2024-04-25T13:16:26.687946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999439+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:16:26.999439+0000","last_peered":"2024-04-25T13:16:26.999439+0000","last_clean":"2024-04-25T13:16:26.999439+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:16:26.999439+0000","last_undegraded":"2024-04-25T13:16:26.999439+0000","last_fullsized":"2024-04-25T13:16:26.999439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687218+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:16:26.687218+0000","last_peered":"2024-04-25T13:16:26.687218+0000","last_clean":"2024-04-25T13:16:26.687218+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:16:26.687218+0000","last_undegraded":"2024-04-25T13:16:26.687218+0000","last_fullsized":"2024-04-25T13:16:26.687218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000395+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:16:27.000395+0000","last_peered":"2024-04-25T13:16:27.000395+0000","last_clean":"2024-04-25T13:16:27.000395+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:16:27.000395+0000","last_undegraded":"2024-04-25T13:16:27.000395+0000","last_fullsized":"2024-04-25T13:16:27.000395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000037+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:16:27.000037+0000","last_peered":"2024-04-25T13:16:27.000037+0000","last_clean":"2024-04-25T13:16:27.000037+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:16:27.000037+0000","last_undegraded":"2024-04-25T13:16:27.000037+0000","last_fullsized":"2024-04-25T13:16:27.000037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828455+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:16:26.828455+0000","last_peered":"2024-04-25T13:16:26.828455+0000","last_clean":"2024-04-25T13:16:26.828455+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:16:26.828455+0000","last_undegraded":"2024-04-25T13:16:26.828455+0000","last_fullsized":"2024-04-25T13:16:26.828455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687324+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:16:26.687324+0000","last_peered":"2024-04-25T13:16:26.687324+0000","last_clean":"2024-04-25T13:16:26.687324+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:16:26.687324+0000","last_undegraded":"2024-04-25T13:16:26.687324+0000","last_fullsized":"2024-04-25T13:16:26.687324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688261+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:16:26.688261+0000","last_peered":"2024-04-25T13:16:26.688261+0000","last_clean":"2024-04-25T13:16:26.688261+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:16:26.688261+0000","last_undegraded":"2024-04-25T13:16:26.688261+0000","last_fullsized":"2024-04-25T13:16:26.688261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687709+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:16:26.687709+0000","last_peered":"2024-04-25T13:16:26.687709+0000","last_clean":"2024-04-25T13:16:26.687709+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:16:26.687709+0000","last_undegraded":"2024-04-25T13:16:26.687709+0000","last_fullsized":"2024-04-25T13:16:26.687709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000780+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:16:27.000780+0000","last_peered":"2024-04-25T13:16:27.000780+0000","last_clean":"2024-04-25T13:16:27.000780+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:16:27.000780+0000","last_undegraded":"2024-04-25T13:16:27.000780+0000","last_fullsized":"2024-04-25T13:16:27.000780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687526+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:16:26.687526+0000","last_peered":"2024-04-25T13:16:26.687526+0000","last_clean":"2024-04-25T13:16:26.687526+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:16:26.687526+0000","last_undegraded":"2024-04-25T13:16:26.687526+0000","last_fullsized":"2024-04-25T13:16:26.687526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828608+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:16:26.828608+0000","last_peered":"2024-04-25T13:16:26.828608+0000","last_clean":"2024-04-25T13:16:26.828608+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:16:26.828608+0000","last_undegraded":"2024-04-25T13:16:26.828608+0000","last_fullsized":"2024-04-25T13:16:26.828608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687640+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:16:26.687640+0000","last_peered":"2024-04-25T13:16:26.687640+0000","last_clean":"2024-04-25T13:16:26.687640+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:16:26.687640+0000","last_undegraded":"2024-04-25T13:16:26.687640+0000","last_fullsized":"2024-04-25T13:16:26.687640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999890+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:16:26.999890+0000","last_peered":"2024-04-25T13:16:26.999890+0000","last_clean":"2024-04-25T13:16:26.999890+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:16:26.999890+0000","last_undegraded":"2024-04-25T13:16:26.999890+0000","last_fullsized":"2024-04-25T13:16:26.999890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688905+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:16:26.688905+0000","last_peered":"2024-04-25T13:16:26.688905+0000","last_clean":"2024-04-25T13:16:26.688905+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:16:26.688905+0000","last_undegraded":"2024-04-25T13:16:26.688905+0000","last_fullsized":"2024-04-25T13:16:26.688905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999838+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:16:26.999838+0000","last_peered":"2024-04-25T13:16:26.999838+0000","last_clean":"2024-04-25T13:16:26.999838+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:16:26.999838+0000","last_undegraded":"2024-04-25T13:16:26.999838+0000","last_fullsized":"2024-04-25T13:16:26.999838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828257+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:16:26.828257+0000","last_peered":"2024-04-25T13:16:26.828257+0000","last_clean":"2024-04-25T13:16:26.828257+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:16:26.828257+0000","last_undegraded":"2024-04-25T13:16:26.828257+0000","last_fullsized":"2024-04-25T13:16:26.828257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687921+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:16:26.687921+0000","last_peered":"2024-04-25T13:16:26.687921+0000","last_clean":"2024-04-25T13:16:26.687921+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:16:26.687921+0000","last_undegraded":"2024-04-25T13:16:26.687921+0000","last_fullsized":"2024-04-25T13:16:26.687921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000245+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:16:27.000245+0000","last_peered":"2024-04-25T13:16:27.000245+0000","last_clean":"2024-04-25T13:16:27.000245+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:16:27.000245+0000","last_undegraded":"2024-04-25T13:16:27.000245+0000","last_fullsized":"2024-04-25T13:16:27.000245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999436+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:16:26.999436+0000","last_peered":"2024-04-25T13:16:26.999436+0000","last_clean":"2024-04-25T13:16:26.999436+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:16:26.999436+0000","last_undegraded":"2024-04-25T13:16:26.999436+0000","last_fullsized":"2024-04-25T13:16:26.999436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999066+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:16:26.999066+0000","last_peered":"2024-04-25T13:16:26.999066+0000","last_clean":"2024-04-25T13:16:26.999066+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:16:26.999066+0000","last_undegraded":"2024-04-25T13:16:26.999066+0000","last_fullsized":"2024-04-25T13:16:26.999066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000256+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:16:27.000256+0000","last_peered":"2024-04-25T13:16:27.000256+0000","last_clean":"2024-04-25T13:16:27.000256+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:16:27.000256+0000","last_undegraded":"2024-04-25T13:16:27.000256+0000","last_fullsized":"2024-04-25T13:16:27.000256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688254+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:16:26.688254+0000","last_peered":"2024-04-25T13:16:26.688254+0000","last_clean":"2024-04-25T13:16:26.688254+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:16:26.688254+0000","last_undegraded":"2024-04-25T13:16:26.688254+0000","last_fullsized":"2024-04-25T13:16:26.688254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687675+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:16:26.687675+0000","last_peered":"2024-04-25T13:16:26.687675+0000","last_clean":"2024-04-25T13:16:26.687675+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:16:26.687675+0000","last_undegraded":"2024-04-25T13:16:26.687675+0000","last_fullsized":"2024-04-25T13:16:26.687675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001041+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:16:27.001041+0000","last_peered":"2024-04-25T13:16:27.001041+0000","last_clean":"2024-04-25T13:16:27.001041+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:16:27.001041+0000","last_undegraded":"2024-04-25T13:16:27.001041+0000","last_fullsized":"2024-04-25T13:16:27.001041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688112+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:16:26.688112+0000","last_peered":"2024-04-25T13:16:26.688112+0000","last_clean":"2024-04-25T13:16:26.688112+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:16:26.688112+0000","last_undegraded":"2024-04-25T13:16:26.688112+0000","last_fullsized":"2024-04-25T13:16:26.688112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828735+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:16:26.828735+0000","last_peered":"2024-04-25T13:16:26.828735+0000","last_clean":"2024-04-25T13:16:26.828735+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:16:26.828735+0000","last_undegraded":"2024-04-25T13:16:26.828735+0000","last_fullsized":"2024-04-25T13:16:26.828735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000341+0000","last_change":"2024-04-25T13:16:25.709677+0000","last_active":"2024-04-25T13:16:27.000341+0000","last_peered":"2024-04-25T13:16:27.000341+0000","last_clean":"2024-04-25T13:16:27.000341+0000","last_became_active":"2024-04-25T13:16:25.707247+0000","last_became_peered":"2024-04-25T13:16:25.707247+0000","last_unstale":"2024-04-25T13:16:27.000341+0000","last_undegraded":"2024-04-25T13:16:27.000341+0000","last_fullsized":"2024-04-25T13:16:27.000341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:37.578438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999611+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:16:26.999611+0000","last_peered":"2024-04-25T13:16:26.999611+0000","last_clean":"2024-04-25T13:16:26.999611+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:16:26.999611+0000","last_undegraded":"2024-04-25T13:16:26.999611+0000","last_fullsized":"2024-04-25T13:16:26.999611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999938+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:16:26.999938+0000","last_peered":"2024-04-25T13:16:26.999938+0000","last_clean":"2024-04-25T13:16:26.999938+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:16:26.999938+0000","last_undegraded":"2024-04-25T13:16:26.999938+0000","last_fullsized":"2024-04-25T13:16:26.999938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828759+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:16:26.828759+0000","last_peered":"2024-04-25T13:16:26.828759+0000","last_clean":"2024-04-25T13:16:26.828759+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:16:26.828759+0000","last_undegraded":"2024-04-25T13:16:26.828759+0000","last_fullsized":"2024-04-25T13:16:26.828759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687616+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:16:26.687616+0000","last_peered":"2024-04-25T13:16:26.687616+0000","last_clean":"2024-04-25T13:16:26.687616+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:16:26.687616+0000","last_undegraded":"2024-04-25T13:16:26.687616+0000","last_fullsized":"2024-04-25T13:16:26.687616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:36.096330+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:16:36.096330+0000","last_peered":"2024-04-25T13:16:36.096330+0000","last_clean":"2024-04-25T13:16:36.096330+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:16:36.096330+0000","last_undegraded":"2024-04-25T13:16:36.096330+0000","last_fullsized":"2024-04-25T13:16:36.096330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687301+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:16:26.687301+0000","last_peered":"2024-04-25T13:16:26.687301+0000","last_clean":"2024-04-25T13:16:26.687301+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:16:26.687301+0000","last_undegraded":"2024-04-25T13:16:26.687301+0000","last_fullsized":"2024-04-25T13:16:26.687301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999970+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:16:26.999970+0000","last_peered":"2024-04-25T13:16:26.999970+0000","last_clean":"2024-04-25T13:16:26.999970+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:16:26.999970+0000","last_undegraded":"2024-04-25T13:16:26.999970+0000","last_fullsized":"2024-04-25T13:16:26.999970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687595+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:16:26.687595+0000","last_peered":"2024-04-25T13:16:26.687595+0000","last_clean":"2024-04-25T13:16:26.687595+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:16:26.687595+0000","last_undegraded":"2024-04-25T13:16:26.687595+0000","last_fullsized":"2024-04-25T13:16:26.687595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999908+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:16:26.999908+0000","last_peered":"2024-04-25T13:16:26.999908+0000","last_clean":"2024-04-25T13:16:26.999908+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:16:26.999908+0000","last_undegraded":"2024-04-25T13:16:26.999908+0000","last_fullsized":"2024-04-25T13:16:26.999908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000683+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:16:27.000683+0000","last_peered":"2024-04-25T13:16:27.000683+0000","last_clean":"2024-04-25T13:16:27.000683+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:16:27.000683+0000","last_undegraded":"2024-04-25T13:16:27.000683+0000","last_fullsized":"2024-04-25T13:16:27.000683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828848+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:16:26.828848+0000","last_peered":"2024-04-25T13:16:26.828848+0000","last_clean":"2024-04-25T13:16:26.828848+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:16:26.828848+0000","last_undegraded":"2024-04-25T13:16:26.828848+0000","last_fullsized":"2024-04-25T13:16:26.828848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001032+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:16:27.001032+0000","last_peered":"2024-04-25T13:16:27.001032+0000","last_clean":"2024-04-25T13:16:27.001032+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:16:27.001032+0000","last_undegraded":"2024-04-25T13:16:27.001032+0000","last_fullsized":"2024-04-25T13:16:27.001032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828856+0000","last_change":"2024-04-25T13:16:21.665570+0000","last_active":"2024-04-25T13:16:26.828856+0000","last_peered":"2024-04-25T13:16:26.828856+0000","last_clean":"2024-04-25T13:16:26.828856+0000","last_became_active":"2024-04-25T13:16:21.665168+0000","last_became_peered":"2024-04-25T13:16:21.665168+0000","last_unstale":"2024-04-25T13:16:26.828856+0000","last_undegraded":"2024-04-25T13:16:26.828856+0000","last_fullsized":"2024-04-25T13:16:26.828856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:00:10.029372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688617+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:16:26.688617+0000","last_peered":"2024-04-25T13:16:26.688617+0000","last_clean":"2024-04-25T13:16:26.688617+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:16:26.688617+0000","last_undegraded":"2024-04-25T13:16:26.688617+0000","last_fullsized":"2024-04-25T13:16:26.688617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000409+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:16:27.000409+0000","last_peered":"2024-04-25T13:16:27.000409+0000","last_clean":"2024-04-25T13:16:27.000409+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:16:27.000409+0000","last_undegraded":"2024-04-25T13:16:27.000409+0000","last_fullsized":"2024-04-25T13:16:27.000409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000112+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:16:27.000112+0000","last_peered":"2024-04-25T13:16:27.000112+0000","last_clean":"2024-04-25T13:16:27.000112+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:16:27.000112+0000","last_undegraded":"2024-04-25T13:16:27.000112+0000","last_fullsized":"2024-04-25T13:16:27.000112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687005+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:16:26.687005+0000","last_peered":"2024-04-25T13:16:26.687005+0000","last_clean":"2024-04-25T13:16:26.687005+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:16:26.687005+0000","last_undegraded":"2024-04-25T13:16:26.687005+0000","last_fullsized":"2024-04-25T13:16:26.687005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828401+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:16:26.828401+0000","last_peered":"2024-04-25T13:16:26.828401+0000","last_clean":"2024-04-25T13:16:26.828401+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:16:26.828401+0000","last_undegraded":"2024-04-25T13:16:26.828401+0000","last_fullsized":"2024-04-25T13:16:26.828401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688528+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:16:26.688528+0000","last_peered":"2024-04-25T13:16:26.688528+0000","last_clean":"2024-04-25T13:16:26.688528+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:16:26.688528+0000","last_undegraded":"2024-04-25T13:16:26.688528+0000","last_fullsized":"2024-04-25T13:16:26.688528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001000+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:16:27.001000+0000","last_peered":"2024-04-25T13:16:27.001000+0000","last_clean":"2024-04-25T13:16:27.001000+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:16:27.001000+0000","last_undegraded":"2024-04-25T13:16:27.001000+0000","last_fullsized":"2024-04-25T13:16:27.001000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000623+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:16:27.000623+0000","last_peered":"2024-04-25T13:16:27.000623+0000","last_clean":"2024-04-25T13:16:27.000623+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:16:27.000623+0000","last_undegraded":"2024-04-25T13:16:27.000623+0000","last_fullsized":"2024-04-25T13:16:27.000623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688455+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:16:26.688455+0000","last_peered":"2024-04-25T13:16:26.688455+0000","last_clean":"2024-04-25T13:16:26.688455+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:16:26.688455+0000","last_undegraded":"2024-04-25T13:16:26.688455+0000","last_fullsized":"2024-04-25T13:16:26.688455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999914+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:16:26.999914+0000","last_peered":"2024-04-25T13:16:26.999914+0000","last_clean":"2024-04-25T13:16:26.999914+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:16:26.999914+0000","last_undegraded":"2024-04-25T13:16:26.999914+0000","last_fullsized":"2024-04-25T13:16:26.999914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999479+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:16:26.999479+0000","last_peered":"2024-04-25T13:16:26.999479+0000","last_clean":"2024-04-25T13:16:26.999479+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:16:26.999479+0000","last_undegraded":"2024-04-25T13:16:26.999479+0000","last_fullsized":"2024-04-25T13:16:26.999479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000587+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:16:27.000587+0000","last_peered":"2024-04-25T13:16:27.000587+0000","last_clean":"2024-04-25T13:16:27.000587+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:16:27.000587+0000","last_undegraded":"2024-04-25T13:16:27.000587+0000","last_fullsized":"2024-04-25T13:16:27.000587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999648+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:16:26.999648+0000","last_peered":"2024-04-25T13:16:26.999648+0000","last_clean":"2024-04-25T13:16:26.999648+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:16:26.999648+0000","last_undegraded":"2024-04-25T13:16:26.999648+0000","last_fullsized":"2024-04-25T13:16:26.999648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000307+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:16:27.000307+0000","last_peered":"2024-04-25T13:16:27.000307+0000","last_clean":"2024-04-25T13:16:27.000307+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:16:27.000307+0000","last_undegraded":"2024-04-25T13:16:27.000307+0000","last_fullsized":"2024-04-25T13:16:27.000307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687291+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:16:26.687291+0000","last_peered":"2024-04-25T13:16:26.687291+0000","last_clean":"2024-04-25T13:16:26.687291+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:16:26.687291+0000","last_undegraded":"2024-04-25T13:16:26.687291+0000","last_fullsized":"2024-04-25T13:16:26.687291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999304+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:16:26.999304+0000","last_peered":"2024-04-25T13:16:26.999304+0000","last_clean":"2024-04-25T13:16:26.999304+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:16:26.999304+0000","last_undegraded":"2024-04-25T13:16:26.999304+0000","last_fullsized":"2024-04-25T13:16:26.999304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828575+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:16:26.828575+0000","last_peered":"2024-04-25T13:16:26.828575+0000","last_clean":"2024-04-25T13:16:26.828575+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:16:26.828575+0000","last_undegraded":"2024-04-25T13:16:26.828575+0000","last_fullsized":"2024-04-25T13:16:26.828575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999830+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:16:26.999830+0000","last_peered":"2024-04-25T13:16:26.999830+0000","last_clean":"2024-04-25T13:16:26.999830+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:16:26.999830+0000","last_undegraded":"2024-04-25T13:16:26.999830+0000","last_fullsized":"2024-04-25T13:16:26.999830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000552+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:16:27.000552+0000","last_peered":"2024-04-25T13:16:27.000552+0000","last_clean":"2024-04-25T13:16:27.000552+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:16:27.000552+0000","last_undegraded":"2024-04-25T13:16:27.000552+0000","last_fullsized":"2024-04-25T13:16:27.000552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687474+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:16:26.687474+0000","last_peered":"2024-04-25T13:16:26.687474+0000","last_clean":"2024-04-25T13:16:26.687474+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:16:26.687474+0000","last_undegraded":"2024-04-25T13:16:26.687474+0000","last_fullsized":"2024-04-25T13:16:26.687474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688587+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:16:26.688587+0000","last_peered":"2024-04-25T13:16:26.688587+0000","last_clean":"2024-04-25T13:16:26.688587+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:16:26.688587+0000","last_undegraded":"2024-04-25T13:16:26.688587+0000","last_fullsized":"2024-04-25T13:16:26.688587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.001087+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:16:27.001087+0000","last_peered":"2024-04-25T13:16:27.001087+0000","last_clean":"2024-04-25T13:16:27.001087+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:16:27.001087+0000","last_undegraded":"2024-04-25T13:16:27.001087+0000","last_fullsized":"2024-04-25T13:16:27.001087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828304+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:16:26.828304+0000","last_peered":"2024-04-25T13:16:26.828304+0000","last_clean":"2024-04-25T13:16:26.828304+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:16:26.828304+0000","last_undegraded":"2024-04-25T13:16:26.828304+0000","last_fullsized":"2024-04-25T13:16:26.828304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000461+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:16:27.000461+0000","last_peered":"2024-04-25T13:16:27.000461+0000","last_clean":"2024-04-25T13:16:27.000461+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:16:27.000461+0000","last_undegraded":"2024-04-25T13:16:27.000461+0000","last_fullsized":"2024-04-25T13:16:27.000461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828566+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:16:26.828566+0000","last_peered":"2024-04-25T13:16:26.828566+0000","last_clean":"2024-04-25T13:16:26.828566+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:16:26.828566+0000","last_undegraded":"2024-04-25T13:16:26.828566+0000","last_fullsized":"2024-04-25T13:16:26.828566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999722+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:16:26.999722+0000","last_peered":"2024-04-25T13:16:26.999722+0000","last_clean":"2024-04-25T13:16:26.999722+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:16:26.999722+0000","last_undegraded":"2024-04-25T13:16:26.999722+0000","last_fullsized":"2024-04-25T13:16:26.999722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688999+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:16:26.688999+0000","last_peered":"2024-04-25T13:16:26.688999+0000","last_clean":"2024-04-25T13:16:26.688999+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:16:26.688999+0000","last_undegraded":"2024-04-25T13:16:26.688999+0000","last_fullsized":"2024-04-25T13:16:26.688999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688200+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:16:26.688200+0000","last_peered":"2024-04-25T13:16:26.688200+0000","last_clean":"2024-04-25T13:16:26.688200+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:16:26.688200+0000","last_undegraded":"2024-04-25T13:16:26.688200+0000","last_fullsized":"2024-04-25T13:16:26.688200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999798+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:16:26.999798+0000","last_peered":"2024-04-25T13:16:26.999798+0000","last_clean":"2024-04-25T13:16:26.999798+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:26.999798+0000","last_undegraded":"2024-04-25T13:16:26.999798+0000","last_fullsized":"2024-04-25T13:16:26.999798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828947+0000","last_change":"2024-04-25T13:16:21.666904+0000","last_active":"2024-04-25T13:16:26.828947+0000","last_peered":"2024-04-25T13:16:26.828947+0000","last_clean":"2024-04-25T13:16:26.828947+0000","last_became_active":"2024-04-25T13:16:21.666638+0000","last_became_peered":"2024-04-25T13:16:21.666638+0000","last_unstale":"2024-04-25T13:16:26.828947+0000","last_undegraded":"2024-04-25T13:16:26.828947+0000","last_fullsized":"2024-04-25T13:16:26.828947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:54.740696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828197+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:16:26.828197+0000","last_peered":"2024-04-25T13:16:26.828197+0000","last_clean":"2024-04-25T13:16:26.828197+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:16:26.828197+0000","last_undegraded":"2024-04-25T13:16:26.828197+0000","last_fullsized":"2024-04-25T13:16:26.828197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687381+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:16:26.687381+0000","last_peered":"2024-04-25T13:16:26.687381+0000","last_clean":"2024-04-25T13:16:26.687381+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:16:26.687381+0000","last_undegraded":"2024-04-25T13:16:26.687381+0000","last_fullsized":"2024-04-25T13:16:26.687381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999585+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:16:26.999585+0000","last_peered":"2024-04-25T13:16:26.999585+0000","last_clean":"2024-04-25T13:16:26.999585+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:16:26.999585+0000","last_undegraded":"2024-04-25T13:16:26.999585+0000","last_fullsized":"2024-04-25T13:16:26.999585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000418+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:16:27.000418+0000","last_peered":"2024-04-25T13:16:27.000418+0000","last_clean":"2024-04-25T13:16:27.000418+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:16:27.000418+0000","last_undegraded":"2024-04-25T13:16:27.000418+0000","last_fullsized":"2024-04-25T13:16:27.000418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999907+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:16:26.999907+0000","last_peered":"2024-04-25T13:16:26.999907+0000","last_clean":"2024-04-25T13:16:26.999907+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:16:26.999907+0000","last_undegraded":"2024-04-25T13:16:26.999907+0000","last_fullsized":"2024-04-25T13:16:26.999907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688332+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:16:26.688332+0000","last_peered":"2024-04-25T13:16:26.688332+0000","last_clean":"2024-04-25T13:16:26.688332+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:16:26.688332+0000","last_undegraded":"2024-04-25T13:16:26.688332+0000","last_fullsized":"2024-04-25T13:16:26.688332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688469+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:16:26.688469+0000","last_peered":"2024-04-25T13:16:26.688469+0000","last_clean":"2024-04-25T13:16:26.688469+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:16:26.688469+0000","last_undegraded":"2024-04-25T13:16:26.688469+0000","last_fullsized":"2024-04-25T13:16:26.688469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688862+0000","last_change":"2024-04-25T13:16:21.665463+0000","last_active":"2024-04-25T13:16:26.688862+0000","last_peered":"2024-04-25T13:16:26.688862+0000","last_clean":"2024-04-25T13:16:26.688862+0000","last_became_active":"2024-04-25T13:16:21.665120+0000","last_became_peered":"2024-04-25T13:16:21.665120+0000","last_unstale":"2024-04-25T13:16:26.688862+0000","last_undegraded":"2024-04-25T13:16:26.688862+0000","last_fullsized":"2024-04-25T13:16:26.688862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:33.552291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:27.000878+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:16:27.000878+0000","last_peered":"2024-04-25T13:16:27.000878+0000","last_clean":"2024-04-25T13:16:27.000878+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:16:27.000878+0000","last_undegraded":"2024-04-25T13:16:27.000878+0000","last_fullsized":"2024-04-25T13:16:27.000878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687369+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:16:26.687369+0000","last_peered":"2024-04-25T13:16:26.687369+0000","last_clean":"2024-04-25T13:16:26.687369+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:16:26.687369+0000","last_undegraded":"2024-04-25T13:16:26.687369+0000","last_fullsized":"2024-04-25T13:16:26.687369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828382+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:16:26.828382+0000","last_peered":"2024-04-25T13:16:26.828382+0000","last_clean":"2024-04-25T13:16:26.828382+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:16:26.828382+0000","last_undegraded":"2024-04-25T13:16:26.828382+0000","last_fullsized":"2024-04-25T13:16:26.828382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687907+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:16:26.687907+0000","last_peered":"2024-04-25T13:16:26.687907+0000","last_clean":"2024-04-25T13:16:26.687907+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:16:26.687907+0000","last_undegraded":"2024-04-25T13:16:26.687907+0000","last_fullsized":"2024-04-25T13:16:26.687907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.828456+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:16:26.828456+0000","last_peered":"2024-04-25T13:16:26.828456+0000","last_clean":"2024-04-25T13:16:26.828456+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:16:26.828456+0000","last_undegraded":"2024-04-25T13:16:26.828456+0000","last_fullsized":"2024-04-25T13:16:26.828456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.999773+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:16:26.999773+0000","last_peered":"2024-04-25T13:16:26.999773+0000","last_clean":"2024-04-25T13:16:26.999773+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:16:26.999773+0000","last_undegraded":"2024-04-25T13:16:26.999773+0000","last_fullsized":"2024-04-25T13:16:26.999773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.687734+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:16:26.687734+0000","last_peered":"2024-04-25T13:16:26.687734+0000","last_clean":"2024-04-25T13:16:26.687734+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:16:26.687734+0000","last_undegraded":"2024-04-25T13:16:26.687734+0000","last_fullsized":"2024-04-25T13:16:26.687734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T13:16:26.688481+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:16:26.688481+0000","last_peered":"2024-04-25T13:16:26.688481+0000","last_clean":"2024-04-25T13:16:26.688481+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:16:26.688481+0000","last_undegraded":"2024-04-25T13:16:26.688481+0000","last_fullsized":"2024-04-25T13:16:26.688481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:16:54.749 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:16:54.749 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T13:16:54.749 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T13:16:54.749 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:54.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.880+0000 7fbaa595d640 1 Processor -- start 2024-04-25T13:16:54.881 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.880+0000 7fbaa595d640 1 -- start start 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fbaa595d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa0072c00 0x7fbaa00c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fbaa595d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbaa0074380 0x7fbaa01637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fbaa595d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa015c850 con 0x7fbaa00c8d00 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fbaa595d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa015cb30 con 0x7fbaa0072c00 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fbaa595d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa015ce10 con 0x7fbaa0074380 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fba9e7fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa0072c00 0x7fbaa00c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fba9e7fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbaa0072c00 0x7fbaa00c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54832/0 (socket says 172.21.15.155:54832) 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fba9e7fc640 1 -- 172.21.15.155:0/2945868586 learned_addr learned my addr 172.21.15.155:0/2945868586 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:54.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.881+0000 7fba9f7fe640 1 --2- 172.21.15.155:0/2945868586 >> v2:172.21.15.191:3300/0 conn(0x7fbaa0074380 0x7fbaa01637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9e7fc640 1 -- 172.21.15.155:0/2945868586 >> v2:172.21.15.191:3300/0 conn(0x7fbaa0074380 msgr2=0x7fbaa01637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:54.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9e7fc640 1 --2- 172.21.15.155:0/2945868586 >> v2:172.21.15.191:3300/0 conn(0x7fbaa0074380 0x7fbaa01637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9e7fc640 1 -- 172.21.15.155:0/2945868586 >> v1:172.21.15.155:6789/0 conn(0x7fbaa00c8d00 legacy=0x7fbaa00c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9e7fc640 1 -- 172.21.15.155:0/2945868586 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa015d0f0 con 0x7fbaa0072c00 2024-04-25T13:16:54.883 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9e7fc640 1 --2- 172.21.15.155:0/2945868586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa00c90e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbaa006d070 tx=0x7fba9402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cd316f819d04db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9dffb640 1 -- 172.21.15.155:0/2945868586 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94037070 con 0x7fbaa0072c00 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9dffb640 1 -- 172.21.15.155:0/2945868586 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9402ae50 con 0x7fbaa0072c00 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.882+0000 7fba9dffb640 1 -- 172.21.15.155:0/2945868586 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba94032860 con 0x7fbaa0072c00 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 -- 172.21.15.155:0/2945868586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 msgr2=0x7fbaa00c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 --2- 172.21.15.155:0/2945868586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa00c90e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbaa006d070 tx=0x7fba9402a300 comp rx=0 tx=0).stop 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 -- 172.21.15.155:0/2945868586 shutdown_connections 2024-04-25T13:16:54.884 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 --2- 172.21.15.155:0/2945868586 >> v2:172.21.15.191:3300/0 conn(0x7fbaa0074380 0x7fbaa01637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 --2- 172.21.15.155:0/2945868586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa00c90e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 -- 172.21.15.155:0/2945868586 >> 172.21.15.155:0/2945868586 conn(0x7fbaa006f2f0 msgr2=0x7fbaa006f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:54.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 -- 172.21.15.155:0/2945868586 shutdown_connections 2024-04-25T13:16:54.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.883+0000 7fbaa595d640 1 -- 172.21.15.155:0/2945868586 wait complete. 2024-04-25T13:16:54.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.884+0000 7fbaa595d640 1 Processor -- start 2024-04-25T13:16:54.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.884+0000 7fbaa595d640 1 -- start start 2024-04-25T13:16:54.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fbaa595d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa0147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fbaa595d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa0074380 0x7fbaa01f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fbaa595d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa00c8d00 0x7fbaa01f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fbaa595d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa01534a0 con 0x7fbaa0072c00 2024-04-25T13:16:54.887 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fbaa595d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa015c410 con 0x7fbaa0074380 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fbaa595d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa014e230 con 0x7fbaa00c8d00 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa0147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa0147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54848/0 (socket says 172.21.15.155:54848) 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 -- 172.21.15.155:0/3200357181 learned_addr learned my addr 172.21.15.155:0/3200357181 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9e7fc640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa0074380 0x7fbaa01f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9f7fe640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa00c8d00 0x7fbaa01f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 -- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa00c8d00 msgr2=0x7fbaa01f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa00c8d00 0x7fbaa01f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 -- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa0074380 msgr2=0x7fbaa01f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa0074380 0x7fbaa01f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.885+0000 7fba9effd640 1 -- 172.21.15.155:0/3200357181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa014e4a0 con 0x7fbaa0072c00 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.886+0000 7fba9effd640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa0147c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba9000c3f0 tx=0x7fba9000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.886+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba900052d0 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.886+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba90005490 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.886+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90007260 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.886+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa014e780 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.886+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa014ed40 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.887+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa00c7580 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.887+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba90007400 con 0x7fbaa0072c00 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.888+0000 7fba87fff640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fba8c06c8f0 0x7fba8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.888+0000 7fba9e7fc640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fba8c06c8f0 0x7fba8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:54.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.888+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fba9008b280 con 0x7fbaa0072c00 2024-04-25T13:16:54.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.888+0000 7fba9e7fc640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fba8c06c8f0 0x7fba8c06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba94034000 tx=0x7fba9402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:54.892 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:54.892+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbaa00c7580 con 0x7fbaa0072c00 2024-04-25T13:16:55.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.105+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbaa0068e40 con 0x7fbaa0072c00 2024-04-25T13:16:55.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.105+0000 7fba87fff640 1 -- 172.21.15.155:0/3200357181 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fba9005f030 con 0x7fbaa0072c00 2024-04-25T13:16:55.109 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:55.109 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fba8c06c8f0 msgr2=0x7fba8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fba8c06c8f0 0x7fba8c06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba94034000 tx=0x7fba9402e000 comp rx=0 tx=0).stop 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 msgr2=0x7fbaa0147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa0147c50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba9000c3f0 tx=0x7fba9000c8b0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 shutdown_connections 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fba8c06c8f0 0x7fba8c06edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbaa00c8d00 0x7fbaa01f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbaa0074380 0x7fbaa01f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 --2- 172.21.15.155:0/3200357181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaa0072c00 0x7fbaa0147c50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:55.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 >> 172.21.15.155:0/3200357181 conn(0x7fbaa006f2f0 msgr2=0x7fbaa0151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:55.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 shutdown_connections 2024-04-25T13:16:55.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:55.107+0000 7fbaa595d640 1 -- 172.21.15.155:0/3200357181 wait complete. 2024-04-25T13:16:56.135 INFO:tasks.ceph.mds.b.smithi191.stderr:2024-04-25T13:16:56.135+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T13:16:58.119 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:16:58.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 Processor -- start 2024-04-25T13:16:58.225 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 -- start start 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc69c155230 0x7fc69c071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c0cb330 0x7fc69c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c06d540 con 0x7fc69c15b030 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c0c9a80 con 0x7fc69c155230 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.225+0000 7fc6a322a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c15b4c0 con 0x7fc69c0cb330 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc69c155230 0x7fc69c071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc69c155230 0x7fc69c071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54860/0 (socket says 172.21.15.155:54860) 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/3145145238 learned_addr learned my addr 172.21.15.155:0/3145145238 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc69bfff640 1 --1- 172.21.15.155:0/3145145238 >> v1:172.21.15.191:6789/0 conn(0x7fc69c15b030 0x7fc69c15ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:38830/0 (socket says 172.21.15.155:38830) 2024-04-25T13:16:58.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a17c7640 1 --2- 172.21.15.155:0/3145145238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c0cb330 0x7fc69c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/3145145238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c0cb330 msgr2=0x7fc69c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:16:58.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 --2- 172.21.15.155:0/3145145238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c0cb330 0x7fc69c0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/3145145238 >> v1:172.21.15.191:6789/0 conn(0x7fc69c15b030 legacy=0x7fc69c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc69b7fe640 1 -- 172.21.15.155:0/3145145238 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759505935 0 0) 0x7fc69c06d540 con 0x7fc69c15b030 2024-04-25T13:16:58.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.226+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/3145145238 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c15b7a0 con 0x7fc69c155230 2024-04-25T13:16:58.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a0fc6640 1 --2- 172.21.15.155:0/3145145238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c071060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc694009e80 tx=0x7fc69402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3c030f94ee490 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc69b7fe640 1 -- 172.21.15.155:0/3145145238 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694036070 con 0x7fc69c155230 2024-04-25T13:16:58.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc69b7fe640 1 -- 172.21.15.155:0/3145145238 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc694031600 con 0x7fc69c155230 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc69b7fe640 1 -- 172.21.15.155:0/3145145238 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6940319d0 con 0x7fc69c155230 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 -- 172.21.15.155:0/3145145238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 msgr2=0x7fc69c071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 --2- 172.21.15.155:0/3145145238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c071060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc694009e80 tx=0x7fc69402a750 comp rx=0 tx=0).stop 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 -- 172.21.15.155:0/3145145238 shutdown_connections 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 --2- 172.21.15.155:0/3145145238 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c0cb330 0x7fc69c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 --2- 172.21.15.155:0/3145145238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c071060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 -- 172.21.15.155:0/3145145238 >> 172.21.15.155:0/3145145238 conn(0x7fc69c074f30 msgr2=0x7fc69c075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 -- 172.21.15.155:0/3145145238 shutdown_connections 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.227+0000 7fc6a322a640 1 -- 172.21.15.155:0/3145145238 wait complete. 2024-04-25T13:16:58.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 Processor -- start 2024-04-25T13:16:58.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 -- start start 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc69c0cb330 0x7fc69c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c1510c0 0x7fc69c141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c15e7c0 con 0x7fc69c155230 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c15bd60 con 0x7fc69c0cb330 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.229+0000 7fc6a322a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c15f3f0 con 0x7fc69c1510c0 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc69c0cb330 0x7fc69c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc69bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54870/0 (socket says 172.21.15.155:54870) 2024-04-25T13:16:58.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc69bfff640 1 -- 172.21.15.155:0/806449978 learned_addr learned my addr 172.21.15.155:0/806449978 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a17c7640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c1510c0 0x7fc69c141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c1510c0 msgr2=0x7fc69c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c1510c0 0x7fc69c141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 msgr2=0x7fc69c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 -- 172.21.15.155:0/806449978 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c15cc00 con 0x7fc69c0cb330 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc69bfff640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a0fc6640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc69c0cb330 0x7fc69c14f4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc69c06d710 tx=0x7fc694004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69403f020 con 0x7fc69c0cb330 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc694037040 con 0x7fc69c0cb330 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c15cea0 con 0x7fc69c0cb330 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc694036070 con 0x7fc69c0cb330 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.230+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c1500a0 con 0x7fc69c0cb330 2024-04-25T13:16:58.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.231+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c1597c0 con 0x7fc69c0cb330 2024-04-25T13:16:58.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.232+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc694042020 con 0x7fc69c0cb330 2024-04-25T13:16:58.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.232+0000 7fc6997fa640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c8f0 0x7fc67c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:16:58.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.232+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc6940ac110 con 0x7fc69c0cb330 2024-04-25T13:16:58.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.232+0000 7fc69bfff640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c8f0 0x7fc67c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:16:58.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.233+0000 7fc69bfff640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c8f0 0x7fc67c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc69c153c50 tx=0x7fc684000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:16:58.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.237+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc69c1597c0 con 0x7fc69c0cb330 2024-04-25T13:16:58.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.450+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc69c068e40 con 0x7fc69c0cb330 2024-04-25T13:16:58.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.450+0000 7fc6997fa640 1 -- 172.21.15.155:0/806449978 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fc694049030 con 0x7fc69c0cb330 2024-04-25T13:16:58.450 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:16:58.451 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:16:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c8f0 msgr2=0x7fc67c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c8f0 0x7fc67c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc69c153c50 tx=0x7fc684000ed0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc69c0cb330 msgr2=0x7fc69c14f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc69c0cb330 0x7fc69c14f4b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc69c06d710 tx=0x7fc694004a40 comp rx=0 tx=0).stop 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 shutdown_connections 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c8f0 0x7fc67c06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc69c1510c0 0x7fc69c141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc69c155230 0x7fc69c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 --2- 172.21.15.155:0/806449978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc69c0cb330 0x7fc69c14f4b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 >> 172.21.15.155:0/806449978 conn(0x7fc69c074f30 msgr2=0x7fc69c075310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 shutdown_connections 2024-04-25T13:16:58.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:16:58.452+0000 7fc6a322a640 1 -- 172.21.15.155:0/806449978 wait complete. 2024-04-25T13:17:01.136 INFO:tasks.ceph.mds.b.smithi191.stderr:2024-04-25T13:17:01.135+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T13:17:01.464 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:17:01.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.572+0000 7faca4f4a640 1 Processor -- start 2024-04-25T13:17:01.572 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.572+0000 7faca4f4a640 1 -- start start 2024-04-25T13:17:01.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.572+0000 7faca4f4a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faca00c5b10 0x7faca00c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7faca4f4a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0073a50 0x7faca0073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7faca4f4a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca0074420 con 0x7faca0142280 2024-04-25T13:17:01.573 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7faca4f4a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faca0142660 con 0x7faca00c5b10 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7faca4f4a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faca00735c0 con 0x7faca0073a50 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9e59c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7faca0142280 0x7faca00c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36278/0 (socket says 172.21.15.155:36278) 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9e59c640 1 -- 172.21.15.155:0/2727755989 learned_addr learned my addr 172.21.15.155:0/2727755989 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9ed9d640 1 --2- 172.21.15.155:0/2727755989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0073a50 0x7faca0073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9dd9b640 1 --2- 172.21.15.155:0/2727755989 >> v2:172.21.15.191:3300/0 conn(0x7faca00c5b10 0x7faca00c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9d59a640 1 -- 172.21.15.155:0/2727755989 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665093951 0 0) 0x7faca0074420 con 0x7faca0142280 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9d59a640 1 -- 172.21.15.155:0/2727755989 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac88003520 con 0x7faca0142280 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9ed9d640 1 -- 172.21.15.155:0/2727755989 >> v2:172.21.15.191:3300/0 conn(0x7faca00c5b10 msgr2=0x7faca00c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9ed9d640 1 --2- 172.21.15.155:0/2727755989 >> v2:172.21.15.191:3300/0 conn(0x7faca00c5b10 0x7faca00c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9ed9d640 1 -- 172.21.15.155:0/2727755989 >> v1:172.21.15.155:6789/0 conn(0x7faca0142280 legacy=0x7faca00c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9ed9d640 1 -- 172.21.15.155:0/2727755989 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca0071df0 con 0x7faca0073a50 2024-04-25T13:17:01.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.573+0000 7fac9dd9b640 1 --2- 172.21.15.155:0/2727755989 >> v2:172.21.15.191:3300/0 conn(0x7faca00c5b10 0x7faca00c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.574+0000 7fac9ed9d640 1 --2- 172.21.15.155:0/2727755989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0073a50 0x7faca0073ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac90009d90 tx=0x7fac9002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd1a9febe9b1d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.574+0000 7fac9d59a640 1 -- 172.21.15.155:0/2727755989 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90007740 con 0x7faca0073a50 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.574+0000 7fac9d59a640 1 -- 172.21.15.155:0/2727755989 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac900078e0 con 0x7faca0073a50 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.574+0000 7fac9d59a640 1 -- 172.21.15.155:0/2727755989 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90007cb0 con 0x7faca0073a50 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 -- 172.21.15.155:0/2727755989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0073a50 msgr2=0x7faca0073ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 --2- 172.21.15.155:0/2727755989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0073a50 0x7faca0073ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fac90009d90 tx=0x7fac9002a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 -- 172.21.15.155:0/2727755989 shutdown_connections 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 --2- 172.21.15.155:0/2727755989 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0073a50 0x7faca0073ee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.576 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 --2- 172.21.15.155:0/2727755989 >> v2:172.21.15.191:3300/0 conn(0x7faca00c5b10 0x7faca00c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 -- 172.21.15.155:0/2727755989 >> 172.21.15.155:0/2727755989 conn(0x7faca006d610 msgr2=0x7faca0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 -- 172.21.15.155:0/2727755989 shutdown_connections 2024-04-25T13:17:01.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.575+0000 7faca4f4a640 1 -- 172.21.15.155:0/2727755989 wait complete. 2024-04-25T13:17:01.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.576+0000 7faca4f4a640 1 Processor -- start 2024-04-25T13:17:01.577 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.576+0000 7faca4f4a640 1 -- start start 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7faca4f4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 0x7faca01dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7faca4f4a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca00c5b10 0x7faca01e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7faca4f4a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0142280 0x7faca01e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7faca4f4a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faca0159570 con 0x7faca0073a50 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7faca4f4a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faca0159290 con 0x7faca00c5b10 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7faca4f4a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faca0159850 con 0x7faca0142280 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 0x7faca01dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 0x7faca01dfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54886/0 (socket says 172.21.15.155:54886) 2024-04-25T13:17:01.579 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 -- 172.21.15.155:0/3282417980 learned_addr learned my addr 172.21.15.155:0/3282417980 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9dd9b640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca00c5b10 0x7faca01e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9ed9d640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0142280 0x7faca01e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 -- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0142280 msgr2=0x7faca01e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0142280 0x7faca01e13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 -- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca00c5b10 msgr2=0x7faca01e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca00c5b10 0x7faca01e03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 -- 172.21.15.155:0/3282417980 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca01e2f00 con 0x7faca0073a50 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac9e59c640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 0x7faca01dfe60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c460 tx=0x7fac9800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98017070 con 0x7faca0073a50 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.577+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac98005ce0 con 0x7faca0073a50 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.578+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca01f2290 con 0x7faca0073a50 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.578+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98007290 con 0x7faca0073a50 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.578+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca01f2850 con 0x7faca0073a50 2024-04-25T13:17:01.580 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.579+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca0068e40 con 0x7faca0073a50 2024-04-25T13:17:01.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.579+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac9801a070 con 0x7faca0073a50 2024-04-25T13:17:01.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.579+0000 7fac8effd640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fac8006c8f0 0x7fac8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:01.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.580+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac9808b290 con 0x7faca0073a50 2024-04-25T13:17:01.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.580+0000 7fac9dd9b640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fac8006c8f0 0x7fac8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:01.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.580+0000 7fac9dd9b640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fac8006c8f0 0x7fac8006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac94009560 tx=0x7fac94009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:01.584 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.584+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac98058c20 con 0x7faca0073a50 2024-04-25T13:17:01.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.805+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faca0140520 con 0x7faca0073a50 2024-04-25T13:17:01.810 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:01.810 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:17:01.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.807+0000 7fac8effd640 1 -- 172.21.15.155:0/3282417980 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7fac98076e20 con 0x7faca0073a50 2024-04-25T13:17:01.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fac8006c8f0 msgr2=0x7fac8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fac8006c8f0 0x7fac8006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac94009560 tx=0x7fac94009190 comp rx=0 tx=0).stop 2024-04-25T13:17:01.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 msgr2=0x7faca01dfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:01.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 0x7faca01dfe60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac9800c460 tx=0x7fac9800c920 comp rx=0 tx=0).stop 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 shutdown_connections 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fac8006c8f0 0x7fac8006edb0 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac94009560 tx=0x7fac94009190 comp rx=0 tx=0).stop 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faca0142280 0x7faca01e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faca00c5b10 0x7faca01e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 --2- 172.21.15.155:0/3282417980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0073a50 0x7faca01dfe60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.811+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 >> 172.21.15.155:0/3282417980 conn(0x7faca006d610 msgr2=0x7faca013f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.812+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 shutdown_connections 2024-04-25T13:17:01.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:01.813+0000 7faca4f4a640 1 -- 172.21.15.155:0/3282417980 wait complete. 2024-04-25T13:17:04.825 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:17:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.932+0000 7faee7ea7640 1 Processor -- start 2024-04-25T13:17:04.932 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.932+0000 7faee7ea7640 1 -- start start 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee7ea7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faee0155230 0x7faee0071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee7ea7640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7faee015b030 0x7faee015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee7ea7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee015f220 0x7faee00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee7ea7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7faee00c9a80 con 0x7faee0155230 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee7ea7640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7faee006d540 con 0x7faee015b030 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee7ea7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faee015b4c0 con 0x7faee015f220 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faee0155230 0x7faee0071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faee0155230 0x7faee0071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52262/0 (socket says 172.21.15.155:52262) 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 -- 172.21.15.155:0/2857055214 learned_addr learned my addr 172.21.15.155:0/2857055214 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5442640 1 --2- 172.21.15.155:0/2857055214 >> v2:172.21.15.191:3300/0 conn(0x7faee015b030 0x7faee015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee6444640 1 --2- 172.21.15.155:0/2857055214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee015f220 0x7faee00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 -- 172.21.15.155:0/2857055214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee015f220 msgr2=0x7faee00cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 --2- 172.21.15.155:0/2857055214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee015f220 0x7faee00cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 -- 172.21.15.155:0/2857055214 >> v2:172.21.15.191:3300/0 conn(0x7faee015b030 msgr2=0x7faee015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 --2- 172.21.15.155:0/2857055214 >> v2:172.21.15.191:3300/0 conn(0x7faee015b030 0x7faee015ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.933+0000 7faee5c43640 1 -- 172.21.15.155:0/2857055214 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee015b7a0 con 0x7faee0155230 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.934+0000 7faee5c43640 1 --2- 172.21.15.155:0/2857055214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0155230 0x7faee0071060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faedc009870 tx=0x7faedc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fae1029baaa09a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.934+0000 7faee4c41640 1 -- 172.21.15.155:0/2857055214 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc037070 con 0x7faee0155230 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.934+0000 7faee4c41640 1 -- 172.21.15.155:0/2857055214 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faedc032440 con 0x7faee0155230 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.934+0000 7faee4c41640 1 -- 172.21.15.155:0/2857055214 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc032810 con 0x7faee0155230 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 -- 172.21.15.155:0/2857055214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0155230 msgr2=0x7faee0071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 --2- 172.21.15.155:0/2857055214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0155230 0x7faee0071060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faedc009870 tx=0x7faedc02a210 comp rx=0 tx=0).stop 2024-04-25T13:17:04.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 -- 172.21.15.155:0/2857055214 shutdown_connections 2024-04-25T13:17:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 --2- 172.21.15.155:0/2857055214 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee015f220 0x7faee00cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 --2- 172.21.15.155:0/2857055214 >> v2:172.21.15.191:3300/0 conn(0x7faee015b030 0x7faee015ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 --2- 172.21.15.155:0/2857055214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0155230 0x7faee0071060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 -- 172.21.15.155:0/2857055214 >> 172.21.15.155:0/2857055214 conn(0x7faee0074f30 msgr2=0x7faee0075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 -- 172.21.15.155:0/2857055214 shutdown_connections 2024-04-25T13:17:04.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.935+0000 7faee7ea7640 1 -- 172.21.15.155:0/2857055214 wait complete. 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.936+0000 7faee7ea7640 1 Processor -- start 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.936+0000 7faee7ea7640 1 -- start start 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee0155230 0x7faee01f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faee015f220 0x7faee0148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 0x7faee0150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faee015e7c0 con 0x7faee0150780 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7faee015bd60 con 0x7faee015f220 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7faee00715a0 con 0x7faee0155230 2024-04-25T13:17:04.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 0x7faee0150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 0x7faee0150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52266/0 (socket says 172.21.15.155:52266) 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 -- 172.21.15.155:0/411911121 learned_addr learned my addr 172.21.15.155:0/411911121 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee5442640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faee015f220 0x7faee0148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee5c43640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee0155230 0x7faee01f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 -- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee0155230 msgr2=0x7faee01f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee0155230 0x7faee01f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 -- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faee015f220 msgr2=0x7faee0148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faee015f220 0x7faee0148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 -- 172.21.15.155:0/411911121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee01f1e60 con 0x7faee0150780 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee6444640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 0x7faee0150e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faed800efc0 tx=0x7faed800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8018020 con 0x7faee0150780 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed8014480 con 0x7faee0150780 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8014870 con 0x7faee0150780 2024-04-25T13:17:04.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee01500a0 con 0x7faee0150780 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.937+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee014f9c0 con 0x7faee0150780 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.938+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee0068e40 con 0x7faee0150780 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.939+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faed8005d10 con 0x7faee0150780 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.939+0000 7faed67fc640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faec406c920 0x7faec406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.939+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7faed808cd00 con 0x7faee0150780 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.939+0000 7faee5c43640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faec406c920 0x7faec406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:04.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.940+0000 7faee5c43640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faec406c920 0x7faec406ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faedc034000 tx=0x7faedc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:04.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:04.944+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faed8022030 con 0x7faee0150780 2024-04-25T13:17:05.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.156+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faee0159640 con 0x7faee0150780 2024-04-25T13:17:05.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.157+0000 7faed67fc640 1 -- 172.21.15.155:0/411911121 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7faed8010040 con 0x7faee0150780 2024-04-25T13:17:05.157 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:05.157 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faec406c920 msgr2=0x7faec406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faec406c920 0x7faec406ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faedc034000 tx=0x7faedc02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 msgr2=0x7faee0150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 0x7faee0150e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faed800efc0 tx=0x7faed800c490 comp rx=0 tx=0).stop 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 shutdown_connections 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faee0150780 0x7faee0150e00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faee015f220 0x7faee0148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7faec406c920 0x7faec406ede0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 --2- 172.21.15.155:0/411911121 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7faee0155230 0x7faee01f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:05.159 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 >> 172.21.15.155:0/411911121 conn(0x7faee0074f30 msgr2=0x7faee0075310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:05.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 shutdown_connections 2024-04-25T13:17:05.160 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:05.159+0000 7faee7ea7640 1 -- 172.21.15.155:0/411911121 wait complete. 2024-04-25T13:17:06.136 INFO:tasks.ceph.mds.b.smithi191.stderr:2024-04-25T13:17:06.136+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-25T13:17:08.170 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:17:08.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.277+0000 7fa3e86ae640 1 Processor -- start 2024-04-25T13:17:08.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.278+0000 7fa3e86ae640 1 -- start start 2024-04-25T13:17:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.278+0000 7fa3e86ae640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa3e0074160 0x7fa3e00c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.278+0000 7fa3e86ae640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e0071df0 con 0x7fa3e0142280 2024-04-25T13:17:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.278+0000 7fa3e86ae640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e0159e10 con 0x7fa3e00c5b10 2024-04-25T13:17:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.278+0000 7fa3e86ae640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e0142660 con 0x7fa3e0074160 2024-04-25T13:17:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e644a640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa3e0142280 0x7fa3e00c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35296/0 (socket says 172.21.15.155:35296) 2024-04-25T13:17:08.279 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e644a640 1 -- 172.21.15.155:0/338173545 learned_addr learned my addr 172.21.15.155:0/338173545 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e6c4b640 1 --2- 172.21.15.155:0/338173545 >> v2:172.21.15.191:3300/0 conn(0x7fa3e0074160 0x7fa3e00c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184845625 0 0) 0x7fa3e0071df0 con 0x7fa3e0142280 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3cc003520 con 0x7fa3e0142280 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839201442 0 0) 0x7fa3e0159e10 con 0x7fa3e00c5b10 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3e0071df0 con 0x7fa3e00c5b10 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/338173545 >> v1:172.21.15.191:6789/0 conn(0x7fa3e00c5b10 legacy=0x7fa3e0073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/338173545 >> v1:172.21.15.155:6789/0 conn(0x7fa3e0142280 legacy=0x7fa3e00c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.279+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/338173545 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0159290 con 0x7fa3e0074160 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.280+0000 7fa3e6c4b640 1 --2- 172.21.15.155:0/338173545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e00c5f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40097a0 tx=0x7fa3d402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c703afa3e9f50e09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.280+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4037070 con 0x7fa3e0074160 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.280+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d4032640 con 0x7fa3e0074160 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.280+0000 7fa3e5448640 1 -- 172.21.15.155:0/338173545 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4032a10 con 0x7fa3e0074160 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.280+0000 7fa3e86ae640 1 -- 172.21.15.155:0/338173545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 msgr2=0x7fa3e00c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.280+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/338173545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e00c5f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40097a0 tx=0x7fa3d402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.281+0000 7fa3e86ae640 1 -- 172.21.15.155:0/338173545 shutdown_connections 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.281+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/338173545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e00c5f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.281+0000 7fa3e86ae640 1 -- 172.21.15.155:0/338173545 >> 172.21.15.155:0/338173545 conn(0x7fa3e006d610 msgr2=0x7fa3e0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.281+0000 7fa3e86ae640 1 -- 172.21.15.155:0/338173545 shutdown_connections 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.281+0000 7fa3e86ae640 1 -- 172.21.15.155:0/338173545 wait complete. 2024-04-25T13:17:08.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.282+0000 7fa3e86ae640 1 Processor -- start 2024-04-25T13:17:08.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.282+0000 7fa3e86ae640 1 -- start start 2024-04-25T13:17:08.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.282+0000 7fa3e86ae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e01f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.282+0000 7fa3e86ae640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3e00c5b10 0x7fa3e00c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e86ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 0x7fa3e01ef250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e86ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0159850 con 0x7fa3e0142280 2024-04-25T13:17:08.285 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e86ae640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e00735c0 con 0x7fa3e0074160 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e86ae640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e0159b30 con 0x7fa3e00c5b10 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 0x7fa3e01ef250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 0x7fa3e01ef250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52282/0 (socket says 172.21.15.155:52282) 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/3494199997 learned_addr learned my addr 172.21.15.155:0/3494199997 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e644a640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e01f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e5c49640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3e00c5b10 0x7fa3e00c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3e00c5b10 msgr2=0x7fa3e00c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3e00c5b10 0x7fa3e00c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 msgr2=0x7fa3e01f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e01f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 -- 172.21.15.155:0/3494199997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0156810 con 0x7fa3e0142280 2024-04-25T13:17:08.286 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e6c4b640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 0x7fa3e01ef250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40098c0 tx=0x7fa3d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4037040 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d4042070 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40308f0 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e01e01b0 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.283+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e01dfed0 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.284+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e0068e40 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.285+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3d4030a90 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.285+0000 7fa3d2ffd640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa3c406c920 0x7fa3c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.285+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa3d40ac770 con 0x7fa3e0142280 2024-04-25T13:17:08.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.285+0000 7fa3e644a640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa3c406c920 0x7fa3c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.286+0000 7fa3e644a640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa3c406c920 0x7fa3c406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000f60 tx=0x7fa3d8007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.290+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3d407a1e0 con 0x7fa3e0142280 2024-04-25T13:17:08.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.500+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa3e0159e10 con 0x7fa3e0142280 2024-04-25T13:17:08.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.500+0000 7fa3d2ffd640 1 -- 172.21.15.155:0/3494199997 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa3d407e4e0 con 0x7fa3e0142280 2024-04-25T13:17:08.503 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:08.503 INFO:teuthology.orchestra.run.smithi155.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa3c406c920 msgr2=0x7fa3c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa3c406c920 0x7fa3c406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000f60 tx=0x7fa3d8007d70 comp rx=0 tx=0).stop 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 msgr2=0x7fa3e01ef250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 0x7fa3e01ef250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40098c0 tx=0x7fa3d40046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 shutdown_connections 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3e0142280 0x7fa3e01ef250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa3c406c920 0x7fa3c406ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa3e00c5b10 0x7fa3e00c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.502+0000 7fa3e86ae640 1 --2- 172.21.15.155:0/3494199997 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa3e0074160 0x7fa3e01f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.503+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 >> 172.21.15.155:0/3494199997 conn(0x7fa3e006d610 msgr2=0x7fa3e00ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.503+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 shutdown_connections 2024-04-25T13:17:08.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.503+0000 7fa3e86ae640 1 -- 172.21.15.155:0/3494199997 wait complete. 2024-04-25T13:17:08.513 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T13:17:08.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:08.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.611+0000 7ff9f25f0640 1 Processor -- start 2024-04-25T13:17:08.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.611+0000 7ff9f25f0640 1 -- start start 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f25f0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec1554a0 0x7ff9ec0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f25f0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9ec0c3320 0x7ff9ec0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f25f0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ec155880 con 0x7ff9ec06d020 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f25f0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec0c9030 con 0x7ff9ec0c3320 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f25f0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec0c9280 con 0x7ff9ec1554a0 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eb7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9ec0c3320 0x7ff9ec0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f0b8d640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7ff9ec06d020 0x7ff9ec15eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:53708/0 (socket says 172.21.15.155:53708) 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9f0b8d640 1 -- 172.21.15.155:0/1837746407 learned_addr learned my addr 172.21.15.155:0/1837746407 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eb7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff9ec0c3320 0x7ff9ec0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52298/0 (socket says 172.21.15.155:52298) 2024-04-25T13:17:08.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9ebfff640 1 --2- 172.21.15.155:0/1837746407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec1554a0 0x7ff9ec0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/1837746407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec1554a0 msgr2=0x7ff9ec0b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eb7fe640 1 --2- 172.21.15.155:0/1837746407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec1554a0 0x7ff9ec0b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eaffd640 1 -- 172.21.15.155:0/1837746407 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638891588 0 0) 0x7ff9ec155880 con 0x7ff9ec06d020 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/1837746407 >> v1:172.21.15.191:6789/0 conn(0x7ff9ec06d020 legacy=0x7ff9ec15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.612+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/1837746407 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0c9560 con 0x7ff9ec0c3320 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9eb7fe640 1 --2- 172.21.15.155:0/1837746407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0c7970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097a0 tx=0x7ff9e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef44519d1f86b5f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9eaffd640 1 -- 172.21.15.155:0/1837746407 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0037070 con 0x7ff9ec0c3320 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9eaffd640 1 -- 172.21.15.155:0/1837746407 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e0032440 con 0x7ff9ec0c3320 2024-04-25T13:17:08.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9eaffd640 1 -- 172.21.15.155:0/1837746407 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0032810 con 0x7ff9ec0c3320 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 -- 172.21.15.155:0/1837746407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 msgr2=0x7ff9ec0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/1837746407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0c7970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00097a0 tx=0x7ff9e002a210 comp rx=0 tx=0).stop 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 -- 172.21.15.155:0/1837746407 shutdown_connections 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/1837746407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0c7970 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/1837746407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec1554a0 0x7ff9ec0b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.618 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 -- 172.21.15.155:0/1837746407 >> 172.21.15.155:0/1837746407 conn(0x7ff9ec0c9a70 msgr2=0x7ff9ec0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 -- 172.21.15.155:0/1837746407 shutdown_connections 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.613+0000 7ff9f25f0640 1 -- 172.21.15.155:0/1837746407 wait complete. 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 Processor -- start 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 -- start start 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec06d020 0x7ff9ec15dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9ec1554a0 0x7ff9ec072c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0c84f0 con 0x7ff9ec0c3320 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec15ead0 con 0x7ff9ec1554a0 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9f25f0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec0c8670 con 0x7ff9ec06d020 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.615+0000 7ff9eb7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0726d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52302/0 (socket says 172.21.15.155:52302) 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/993831859 learned_addr learned my addr 172.21.15.155:0/993831859 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:08.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9f0b8d640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9ec1554a0 0x7ff9ec072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9ebfff640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec06d020 0x7ff9ec15dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec06d020 msgr2=0x7ff9ec15dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec06d020 0x7ff9ec15dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9ec1554a0 msgr2=0x7ff9ec072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9ec1554a0 0x7ff9ec072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 -- 172.21.15.155:0/993831859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec14e880 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9eb7fe640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0726d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0035040 tx=0x7ff9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0037050 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e0038040 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec153fa0 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0004470 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.616+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec1f1760 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.617+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec1f19a0 con 0x7ff9ec0c3320 2024-04-25T13:17:08.620 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.618+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9e003c6d0 con 0x7ff9ec0c3320 2024-04-25T13:17:08.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.618+0000 7ff9e8ff9640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff9d806c8f0 0x7ff9d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.618+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff9e00ac940 con 0x7ff9ec0c3320 2024-04-25T13:17:08.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.618+0000 7ff9ebfff640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff9d806c8f0 0x7ff9d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.618+0000 7ff9ebfff640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff9d806c8f0 0x7ff9d806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009aa0 tx=0x7ff9dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.622+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff9ec1f19a0 con 0x7ff9ec0c3320 2024-04-25T13:17:08.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.801+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9ec068e40 con 0x7ff9ec0c3320 2024-04-25T13:17:08.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.802+0000 7ff9e8ff9640 1 -- 172.21.15.155:0/993831859 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7ff9e007a210 con 0x7ff9ec0c3320 2024-04-25T13:17:08.803 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:08.803 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.804+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff9d806c8f0 msgr2=0x7ff9d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.804+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff9d806c8f0 0x7ff9d806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009aa0 tx=0x7ff9dc009190 comp rx=0 tx=0).stop 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.804+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 msgr2=0x7ff9ec0726d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.804+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0726d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0035040 tx=0x7ff9e00046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 shutdown_connections 2024-04-25T13:17:08.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9ec1554a0 0x7ff9ec072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9ec0c3320 0x7ff9ec0726d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff9d806c8f0 0x7ff9d806edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 --2- 172.21.15.155:0/993831859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff9ec06d020 0x7ff9ec15dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 >> 172.21.15.155:0/993831859 conn(0x7ff9ec0c9a70 msgr2=0x7ff9ec0c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 shutdown_connections 2024-04-25T13:17:08.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.805+0000 7ff9f25f0640 1 -- 172.21.15.155:0/993831859 wait complete. 2024-04-25T13:17:08.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:19.529860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:19.949095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:23.675819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:08.816 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:08.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.916+0000 7f6e9644e640 1 Processor -- start 2024-04-25T13:17:08.916 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.916+0000 7f6e9644e640 1 -- start start 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e9644e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e90154f00 0x7f6e90073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e9644e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9015be60 con 0x7f6e900b3600 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e9644e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9015e650 con 0x7f6e900cc710 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e9644e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9015e930 con 0x7f6e90154f00 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8f7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6e900b3600 0x7f6e900cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35304/0 (socket says 172.21.15.155:35304) 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8f7fe640 1 -- 172.21.15.155:0/1363024051 learned_addr learned my addr 172.21.15.155:0/1363024051 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8ffff640 1 --2- 172.21.15.155:0/1363024051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e90154f00 0x7f6e90073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606546639 0 0) 0x7f6e9015be60 con 0x7f6e900b3600 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e78003520 con 0x7f6e900b3600 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737535428 0 0) 0x7f6e9015e650 con 0x7f6e900cc710 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e9015be60 con 0x7f6e900cc710 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8ffff640 1 -- 172.21.15.155:0/1363024051 >> v1:172.21.15.191:6789/0 conn(0x7f6e900cc710 legacy=0x7f6e90165940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8ffff640 1 -- 172.21.15.155:0/1363024051 >> v1:172.21.15.155:6789/0 conn(0x7f6e900b3600 legacy=0x7f6e900cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.917+0000 7f6e8ffff640 1 -- 172.21.15.155:0/1363024051 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9015ec10 con 0x7f6e90154f00 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.918+0000 7f6e8ffff640 1 --2- 172.21.15.155:0/1363024051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e90154f00 0x7f6e90073110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097d0 tx=0x7f6e8002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ce2835ae2cbdf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.918+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80037070 con 0x7f6e90154f00 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.918+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e80032440 con 0x7f6e90154f00 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.918+0000 7f6e8effd640 1 -- 172.21.15.155:0/1363024051 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80032810 con 0x7f6e90154f00 2024-04-25T13:17:08.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 -- 172.21.15.155:0/1363024051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e90154f00 msgr2=0x7f6e90073110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 --2- 172.21.15.155:0/1363024051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e90154f00 0x7f6e90073110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097d0 tx=0x7f6e8002a210 comp rx=0 tx=0).stop 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 -- 172.21.15.155:0/1363024051 shutdown_connections 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 --2- 172.21.15.155:0/1363024051 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e90154f00 0x7f6e90073110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 -- 172.21.15.155:0/1363024051 >> 172.21.15.155:0/1363024051 conn(0x7f6e90068570 msgr2=0x7f6e90071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 -- 172.21.15.155:0/1363024051 shutdown_connections 2024-04-25T13:17:08.921 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.919+0000 7f6e9644e640 1 -- 172.21.15.155:0/1363024051 wait complete. 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.920+0000 7f6e9644e640 1 Processor -- start 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.920+0000 7f6e9644e640 1 -- start start 2024-04-25T13:17:08.924 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e9644e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e900b3600 0x7f6e901e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e9644e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 0x7f6e9014e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e9644e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e90154f00 0x7f6e9014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e9644e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e901552e0 con 0x7f6e900cc710 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e9644e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900cb230 con 0x7f6e90154f00 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e9644e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e901e4e80 con 0x7f6e900b3600 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 0x7f6e9014e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 0x7f6e9014e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52316/0 (socket says 172.21.15.155:52316) 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 -- 172.21.15.155:0/4088327537 learned_addr learned my addr 172.21.15.155:0/4088327537 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8ffff640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e900b3600 0x7f6e901e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e949eb640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e90154f00 0x7f6e9014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.925 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 -- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e900b3600 msgr2=0x7f6e901e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e900b3600 0x7f6e901e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 -- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e90154f00 msgr2=0x7f6e9014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e90154f00 0x7f6e9014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 -- 172.21.15.155:0/4088327537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e901e53b0 con 0x7f6e900cc710 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8f7fe640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 0x7f6e9014e4e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c500 tx=0x7f6e8400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.921+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84017070 con 0x7f6e900cc710 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.922+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e84005d00 con 0x7f6e900cc710 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.922+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84007330 con 0x7f6e900cc710 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.922+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e901e50d0 con 0x7f6e900cc710 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.922+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901e5c40 con 0x7f6e900cc710 2024-04-25T13:17:08.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.923+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e900c7710 con 0x7f6e900cc710 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.923+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e8401a070 con 0x7f6e900cc710 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.923+0000 7f6e8cff9640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.923+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6e8408b220 con 0x7f6e900cc710 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.924+0000 7f6e8ffff640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.924+0000 7f6e8ffff640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6e80034000 tx=0x7f6e8002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:08.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:08.928+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e900c7710 con 0x7f6e900cc710 2024-04-25T13:17:09.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.101+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e90068f50 con 0x7f6e900cc710 2024-04-25T13:17:09.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.102+0000 7f6e8cff9640 1 -- 172.21.15.155:0/4088327537 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f6e84058d50 con 0x7f6e900cc710 2024-04-25T13:17:09.102 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:17:09.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e7c06c8f0 msgr2=0x7f6e7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6e80034000 tx=0x7f6e8002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:09.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 msgr2=0x7f6e9014e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 0x7f6e9014e4e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400c500 tx=0x7f6e8400c9c0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 shutdown_connections 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e90154f00 0x7f6e9014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e900cc710 0x7f6e9014e4e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 --2- 172.21.15.155:0/4088327537 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e900b3600 0x7f6e901e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 >> 172.21.15.155:0/4088327537 conn(0x7f6e90068570 msgr2=0x7f6e90072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 shutdown_connections 2024-04-25T13:17:09.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.104+0000 7f6e9644e640 1 -- 172.21.15.155:0/4088327537 wait complete. 2024-04-25T13:17:09.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:09.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.215+0000 7f94c1136640 1 Processor -- start 2024-04-25T13:17:09.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.215+0000 7f94c1136640 1 -- start start 2024-04-25T13:17:09.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94c1136640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94bc1554e0 0x7f94bc0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94c1136640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc0d1510 con 0x7f94bc0cc6f0 2024-04-25T13:17:09.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94c1136640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc15b5d0 con 0x7f94bc0d1010 2024-04-25T13:17:09.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94c1136640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc0cced0 con 0x7f94bc1554e0 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94bad9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94bc1554e0 0x7f94bc0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94bad9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94bc1554e0 0x7f94bc0d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52320/0 (socket says 172.21.15.155:52320) 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94bad9d640 1 -- 172.21.15.155:0/2774362784 learned_addr learned my addr 172.21.15.155:0/2774362784 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94ba59c640 1 -- 172.21.15.155:0/2774362784 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418603207 0 0) 0x7f94bc15b5d0 con 0x7f94bc0d1010 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94bad9d640 1 -- 172.21.15.155:0/2774362784 >> v1:172.21.15.191:6789/0 conn(0x7f94bc0d1010 legacy=0x7f94bc0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94bad9d640 1 -- 172.21.15.155:0/2774362784 >> v1:172.21.15.155:6789/0 conn(0x7f94bc0cc6f0 legacy=0x7f94bc0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.216+0000 7f94bad9d640 1 -- 172.21.15.155:0/2774362784 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc15b8b0 con 0x7f94bc1554e0 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.217+0000 7f94bad9d640 1 --2- 172.21.15.155:0/2774362784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc1554e0 0x7f94bc0d0ad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009870 tx=0x7f94ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6bb34073de9032 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.217+0000 7f94ba59c640 1 -- 172.21.15.155:0/2774362784 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac037070 con 0x7f94bc1554e0 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.217+0000 7f94ba59c640 1 -- 172.21.15.155:0/2774362784 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ac02ae50 con 0x7f94bc1554e0 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.217+0000 7f94ba59c640 1 -- 172.21.15.155:0/2774362784 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ac032860 con 0x7f94bc1554e0 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.217+0000 7f94c1136640 1 -- 172.21.15.155:0/2774362784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc1554e0 msgr2=0x7f94bc0d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.217+0000 7f94c1136640 1 --2- 172.21.15.155:0/2774362784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc1554e0 0x7f94bc0d0ad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009870 tx=0x7f94ac02a300 comp rx=0 tx=0).stop 2024-04-25T13:17:09.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.218+0000 7f94c1136640 1 -- 172.21.15.155:0/2774362784 shutdown_connections 2024-04-25T13:17:09.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.218+0000 7f94c1136640 1 --2- 172.21.15.155:0/2774362784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc1554e0 0x7f94bc0d0ad0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.218+0000 7f94c1136640 1 -- 172.21.15.155:0/2774362784 >> 172.21.15.155:0/2774362784 conn(0x7f94bc074d50 msgr2=0x7f94bc075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.218+0000 7f94c1136640 1 -- 172.21.15.155:0/2774362784 shutdown_connections 2024-04-25T13:17:09.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.218+0000 7f94c1136640 1 -- 172.21.15.155:0/2774362784 wait complete. 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.219+0000 7f94c1136640 1 Processor -- start 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.219+0000 7f94c1136640 1 -- start start 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94bc0cc6f0 0x7f94bc0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 0x7f94bc1f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94bc1554e0 0x7f94bc150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc15b280 con 0x7f94bc0d1010 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc15bf00 con 0x7f94bc0cc6f0 2024-04-25T13:17:09.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc1558c0 con 0x7f94bc1554e0 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 0x7f94bc1f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 0x7f94bc1f4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52332/0 (socket says 172.21.15.155:52332) 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 -- 172.21.15.155:0/1624780637 learned_addr learned my addr 172.21.15.155:0/1624780637 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94bad9d640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94bc0cc6f0 0x7f94bc0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94bb59e640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94bc1554e0 0x7f94bc150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 -- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94bc1554e0 msgr2=0x7f94bc150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94bc1554e0 0x7f94bc150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 -- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94bc0cc6f0 msgr2=0x7f94bc0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94bc0cc6f0 0x7f94bc0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 -- 172.21.15.155:0/1624780637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc0c8bb0 con 0x7f94bc0d1010 2024-04-25T13:17:09.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b3fff640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 0x7f94bc1f4060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c460 tx=0x7f94a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4017070 con 0x7f94bc0d1010 2024-04-25T13:17:09.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a40035f0 con 0x7f94bc0d1010 2024-04-25T13:17:09.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc1f4a20 con 0x7f94bc0d1010 2024-04-25T13:17:09.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a40039a0 con 0x7f94bc0d1010 2024-04-25T13:17:09.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.220+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc0ca4e0 con 0x7f94bc0d1010 2024-04-25T13:17:09.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.221+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc0d0ad0 con 0x7f94bc0d1010 2024-04-25T13:17:09.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.222+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94a401a070 con 0x7f94bc0d1010 2024-04-25T13:17:09.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.222+0000 7f94b37fe640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f949c06c8f0 0x7f949c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.222+0000 7f94bad9d640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f949c06c8f0 0x7f949c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.222+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f94a408b220 con 0x7f94bc0d1010 2024-04-25T13:17:09.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.223+0000 7f94bad9d640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f949c06c8f0 0x7f949c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f94ac034000 tx=0x7f94ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.227+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94bc0d0ad0 con 0x7f94bc0d1010 2024-04-25T13:17:09.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.401+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f94bc068e40 con 0x7f94bc0d1010 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.402+0000 7f94b37fe640 1 -- 172.21.15.155:0/1624780637 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f94a4058b70 con 0x7f94bc0d1010 2024-04-25T13:17:09.402 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.403+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f949c06c8f0 msgr2=0x7f949c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.403+0000 7f94c1136640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f949c06c8f0 0x7f949c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f94ac034000 tx=0x7f94ac02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.403+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 msgr2=0x7f94bc1f4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 0x7f94bc1f4060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94a400c460 tx=0x7f94a400c920 comp rx=0 tx=0).stop 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 shutdown_connections 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f949c06c8f0 0x7f949c06edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f94bc1554e0 0x7f94bc150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94bc0d1010 0x7f94bc1f4060 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 --2- 172.21.15.155:0/1624780637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f94bc0cc6f0 0x7f94bc0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 >> 172.21.15.155:0/1624780637 conn(0x7f94bc074d50 msgr2=0x7f94bc0b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 shutdown_connections 2024-04-25T13:17:09.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.404+0000 7f94c1136640 1 -- 172.21.15.155:0/1624780637 wait complete. 2024-04-25T13:17:09.414 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:09.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.514+0000 7f62fa176640 1 Processor -- start 2024-04-25T13:17:09.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.514+0000 7f62fa176640 1 -- start start 2024-04-25T13:17:09.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62fa176640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f62f406cfe0 0x7f62f4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62fa176640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62f40cbc00 0x7f62f4155460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62fa176640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f415b190 con 0x7f62f406cc00 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62fa176640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f62f40cd140 con 0x7f62f40cbc00 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62fa176640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f62f415b470 con 0x7f62f406cfe0 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62f40cbc00 0x7f62f4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f62f40cbc00 0x7f62f4155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52338/0 (socket says 172.21.15.155:52338) 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 -- 172.21.15.155:0/1048410121 learned_addr learned my addr 172.21.15.155:0/1048410121 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f2ffd640 1 --2- 172.21.15.155:0/1048410121 >> v2:172.21.15.191:3300/0 conn(0x7f62f406cfe0 0x7f62f4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 -- 172.21.15.155:0/1048410121 >> v2:172.21.15.191:3300/0 conn(0x7f62f406cfe0 msgr2=0x7f62f4154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 --2- 172.21.15.155:0/1048410121 >> v2:172.21.15.191:3300/0 conn(0x7f62f406cfe0 0x7f62f4154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 -- 172.21.15.155:0/1048410121 >> v1:172.21.15.155:6789/0 conn(0x7f62f406cc00 legacy=0x7f62f415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.515+0000 7f62f3fff640 1 -- 172.21.15.155:0/1048410121 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f415b750 con 0x7f62f40cbc00 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.516+0000 7f62f3fff640 1 --2- 172.21.15.155:0/1048410121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f40cbc00 0x7f62f4155460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009e50 tx=0x7f62ec02a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8187999bd4fbe8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.516+0000 7f62f27fc640 1 -- 172.21.15.155:0/1048410121 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec036070 con 0x7f62f40cbc00 2024-04-25T13:17:09.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.516+0000 7f62f27fc640 1 -- 172.21.15.155:0/1048410121 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec031600 con 0x7f62f40cbc00 2024-04-25T13:17:09.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.516+0000 7f62f27fc640 1 -- 172.21.15.155:0/1048410121 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0319d0 con 0x7f62f40cbc00 2024-04-25T13:17:09.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 -- 172.21.15.155:0/1048410121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f40cbc00 msgr2=0x7f62f4155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 --2- 172.21.15.155:0/1048410121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f40cbc00 0x7f62f4155460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009e50 tx=0x7f62ec02a7f0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 -- 172.21.15.155:0/1048410121 shutdown_connections 2024-04-25T13:17:09.520 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 --2- 172.21.15.155:0/1048410121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f40cbc00 0x7f62f4155460 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 --2- 172.21.15.155:0/1048410121 >> v2:172.21.15.191:3300/0 conn(0x7f62f406cfe0 0x7f62f4154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 -- 172.21.15.155:0/1048410121 >> 172.21.15.155:0/1048410121 conn(0x7f62f4075570 msgr2=0x7f62f4073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 -- 172.21.15.155:0/1048410121 shutdown_connections 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.517+0000 7f62fa176640 1 -- 172.21.15.155:0/1048410121 wait complete. 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.518+0000 7f62fa176640 1 Processor -- start 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.518+0000 7f62fa176640 1 -- start start 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62fa176640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 0x7f62f41e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62fa176640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f406cfe0 0x7f62f40c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62fa176640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f40cbc00 0x7f62f41f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62fa176640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40ccbe0 con 0x7f62f406cc00 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62fa176640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f62f415bd10 con 0x7f62f406cfe0 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62fa176640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f62f40ccd60 con 0x7f62f40cbc00 2024-04-25T13:17:09.521 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 0x7f62f41e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 0x7f62f41e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52352/0 (socket says 172.21.15.155:52352) 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 -- 172.21.15.155:0/1582924886 learned_addr learned my addr 172.21.15.155:0/1582924886 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f2ffd640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f406cfe0 0x7f62f40c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f3fff640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f40cbc00 0x7f62f41f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 -- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f40cbc00 msgr2=0x7f62f41f0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f40cbc00 0x7f62f41f0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 -- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f406cfe0 msgr2=0x7f62f40c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f406cfe0 0x7f62f40c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 -- 172.21.15.155:0/1582924886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f41e6af0 con 0x7f62f406cc00 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.519+0000 7f62f37fe640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 0x7f62f41e60f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c430 tx=0x7f62e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.520+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e40052d0 con 0x7f62f406cc00 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.520+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4005490 con 0x7f62f406cc00 2024-04-25T13:17:09.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.520+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f41e4830 con 0x7f62f406cc00 2024-04-25T13:17:09.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.520+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4007260 con 0x7f62f406cc00 2024-04-25T13:17:09.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.520+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41e6830 con 0x7f62f406cc00 2024-04-25T13:17:09.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.520+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4068f50 con 0x7f62f406cc00 2024-04-25T13:17:09.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.521+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62e4007400 con 0x7f62f406cc00 2024-04-25T13:17:09.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.521+0000 7f62dbfff640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f62e006c920 0x7f62e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.521+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f62e408b380 con 0x7f62f406cc00 2024-04-25T13:17:09.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.522+0000 7f62f2ffd640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f62e006c920 0x7f62e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.524 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.522+0000 7f62f2ffd640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f62e006c920 0x7f62e006ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62f40cfda0 tx=0x7f62e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.526+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62f41e4830 con 0x7f62f406cc00 2024-04-25T13:17:09.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.706+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62f40b3420 con 0x7f62f406cc00 2024-04-25T13:17:09.706 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.706+0000 7f62dbfff640 1 -- 172.21.15.155:0/1582924886 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f62e4058d60 con 0x7f62f406cc00 2024-04-25T13:17:09.707 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f62e006c920 msgr2=0x7f62e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f62e006c920 0x7f62e006ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62f40cfda0 tx=0x7f62e8009190 comp rx=0 tx=0).stop 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 msgr2=0x7f62f41e60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 0x7f62f41e60f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c430 tx=0x7f62e400c8f0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 shutdown_connections 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f62e006c920 0x7f62e006ede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f62f40cbc00 0x7f62f41f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f406cfe0 0x7f62f40c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 --2- 172.21.15.155:0/1582924886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62f406cc00 0x7f62f41e60f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.708+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 >> 172.21.15.155:0/1582924886 conn(0x7f62f4075570 msgr2=0x7f62f4153400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.709 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.709+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 shutdown_connections 2024-04-25T13:17:09.710 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.709+0000 7f62fa176640 1 -- 172.21.15.155:0/1582924886 wait complete. 2024-04-25T13:17:09.719 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:09.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.820+0000 7fccae715640 1 Processor -- start 2024-04-25T13:17:09.820 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.820+0000 7fccae715640 1 -- start start 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccae715640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fcca81554e0 0x7fcca80d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccae715640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcca80d1010 0x7fcca80cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccae715640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80cc6f0 0x7fcca80cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccae715640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcca80cced0 con 0x7fcca80d1010 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccae715640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fcca815bf00 con 0x7fcca81554e0 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccae715640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcca80d1510 con 0x7fcca80cc6f0 2024-04-25T13:17:09.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcca80d1010 0x7fcca80cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcca80d1010 0x7fcca80cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52358/0 (socket says 172.21.15.155:52358) 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 -- 172.21.15.155:0/2913138079 learned_addr learned my addr 172.21.15.155:0/2913138079 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca7fff640 1 --2- 172.21.15.155:0/2913138079 >> v2:172.21.15.191:3300/0 conn(0x7fcca81554e0 0x7fcca80d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fccaccb2640 1 --2- 172.21.15.155:0/2913138079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80cc6f0 0x7fcca80cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 -- 172.21.15.155:0/2913138079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80cc6f0 msgr2=0x7fcca80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 --2- 172.21.15.155:0/2913138079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80cc6f0 0x7fcca80cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 -- 172.21.15.155:0/2913138079 >> v2:172.21.15.191:3300/0 conn(0x7fcca81554e0 msgr2=0x7fcca80d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 --2- 172.21.15.155:0/2913138079 >> v2:172.21.15.191:3300/0 conn(0x7fcca81554e0 0x7fcca80d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.821+0000 7fcca77fe640 1 -- 172.21.15.155:0/2913138079 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca815b5d0 con 0x7fcca80d1010 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.822+0000 7fcca77fe640 1 --2- 172.21.15.155:0/2913138079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80d1010 0x7fcca80cb800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcca808ea10 tx=0x7fcc9802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6ab37a04b0022d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.822+0000 7fcca6ffd640 1 -- 172.21.15.155:0/2913138079 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98037070 con 0x7fcca80d1010 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.822+0000 7fcca6ffd640 1 -- 172.21.15.155:0/2913138079 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98032440 con 0x7fcca80d1010 2024-04-25T13:17:09.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.822+0000 7fcca6ffd640 1 -- 172.21.15.155:0/2913138079 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98032810 con 0x7fcca80d1010 2024-04-25T13:17:09.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 -- 172.21.15.155:0/2913138079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80d1010 msgr2=0x7fcca80cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 --2- 172.21.15.155:0/2913138079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80d1010 0x7fcca80cb800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcca808ea10 tx=0x7fcc9802a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 -- 172.21.15.155:0/2913138079 shutdown_connections 2024-04-25T13:17:09.826 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 --2- 172.21.15.155:0/2913138079 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80cc6f0 0x7fcca80cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 --2- 172.21.15.155:0/2913138079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80d1010 0x7fcca80cb800 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 --2- 172.21.15.155:0/2913138079 >> v2:172.21.15.191:3300/0 conn(0x7fcca81554e0 0x7fcca80d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 -- 172.21.15.155:0/2913138079 >> 172.21.15.155:0/2913138079 conn(0x7fcca8074d50 msgr2=0x7fcca8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 -- 172.21.15.155:0/2913138079 shutdown_connections 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.823+0000 7fccae715640 1 -- 172.21.15.155:0/2913138079 wait complete. 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.824+0000 7fccae715640 1 Processor -- start 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.824+0000 7fccae715640 1 -- start start 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccae715640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 0x7fcca8152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccae715640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80d1010 0x7fcca80c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccae715640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca81554e0 0x7fcca8157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccae715640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcca815b280 con 0x7fcca80cc6f0 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccae715640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fcca815bb90 con 0x7fcca81554e0 2024-04-25T13:17:09.827 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccae715640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fcca81558c0 con 0x7fcca80d1010 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 0x7fcca8152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca77fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80d1010 0x7fcca80c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 0x7fcca8152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52364/0 (socket says 172.21.15.155:52364) 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fccaccb2640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca81554e0 0x7fcca8157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 -- 172.21.15.155:0/835091092 learned_addr learned my addr 172.21.15.155:0/835091092 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 -- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80d1010 msgr2=0x7fcca80c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80d1010 0x7fcca80c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 -- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca81554e0 msgr2=0x7fcca8157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca81554e0 0x7fcca8157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 -- 172.21.15.155:0/835091092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca80b3540 con 0x7fcca80cc6f0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.825+0000 7fcca7fff640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 0x7fcca8152940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00e8a0 tx=0x7fcc9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.826+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c017070 con 0x7fcca80cc6f0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.826+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00c940 con 0x7fcca80cc6f0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.826+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca80b3800 con 0x7fcca80cc6f0 2024-04-25T13:17:09.828 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.826+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00cd30 con 0x7fcca80cc6f0 2024-04-25T13:17:09.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.826+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca81f4490 con 0x7fcca80cc6f0 2024-04-25T13:17:09.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.827+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc9c01a070 con 0x7fcca80cc6f0 2024-04-25T13:17:09.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.828+0000 7fcca4ff9640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fcc9406c920 0x7fcc9406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:09.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.828+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca8068e40 con 0x7fcca80cc6f0 2024-04-25T13:17:09.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.828+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fcc9c08bd80 con 0x7fcca80cc6f0 2024-04-25T13:17:09.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.828+0000 7fcca77fe640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fcc9406c920 0x7fcc9406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:09.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.828+0000 7fcca77fe640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fcc9406c920 0x7fcc9406ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcc98034000 tx=0x7fcc9802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:09.833 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:09.834+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc9c01b3b0 con 0x7fcca80cc6f0 2024-04-25T13:17:10.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.010+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcca8153730 con 0x7fcca80cc6f0 2024-04-25T13:17:10.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.011+0000 7fcca4ff9640 1 -- 172.21.15.155:0/835091092 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fcc9c0596d0 con 0x7fcca80cc6f0 2024-04-25T13:17:10.011 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:10.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fcc9406c920 msgr2=0x7fcc9406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fcc9406c920 0x7fcc9406ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcc98034000 tx=0x7fcc9802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:10.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 msgr2=0x7fcca8152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 0x7fcca8152940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00e8a0 tx=0x7fcc9c00ed60 comp rx=0 tx=0).stop 2024-04-25T13:17:10.013 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 shutdown_connections 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcca81554e0 0x7fcca8157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fcc9406c920 0x7fcc9406ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fcca80d1010 0x7fcca80c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 --2- 172.21.15.155:0/835091092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcca80cc6f0 0x7fcca8152940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 >> 172.21.15.155:0/835091092 conn(0x7fcca8074d50 msgr2=0x7fcca80b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 shutdown_connections 2024-04-25T13:17:10.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.013+0000 7fccae715640 1 -- 172.21.15.155:0/835091092 wait complete. 2024-04-25T13:17:10.024 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:10.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.120+0000 7f6fd5091640 1 Processor -- start 2024-04-25T13:17:10.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.120+0000 7f6fd5091640 1 -- start start 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fd5091640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd0151e70 0x7f6fd00cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fd5091640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd0157e60 con 0x7f6fd00ca610 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fd5091640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd0158100 con 0x7f6fd00c88f0 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fd5091640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd0157c30 con 0x7f6fd0151e70 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fcf59e640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6fd00ca610 0x7f6fd0072960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35340/0 (socket says 172.21.15.155:35340) 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fcf59e640 1 -- 172.21.15.155:0/2634465054 learned_addr learned my addr 172.21.15.155:0/2634465054 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:10.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.121+0000 7f6fced9d640 1 --2- 172.21.15.155:0/2634465054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd0151e70 0x7f6fd00cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954310040 0 0) 0x7f6fd0157e60 con 0x7f6fd00ca610 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb8003520 con 0x7f6fd00ca610 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284570573 0 0) 0x7f6fd0158100 con 0x7f6fd00c88f0 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd0157e60 con 0x7f6fd00c88f0 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fced9d640 1 -- 172.21.15.155:0/2634465054 >> v1:172.21.15.191:6789/0 conn(0x7f6fd00c88f0 legacy=0x7f6fd0072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fced9d640 1 -- 172.21.15.155:0/2634465054 >> v1:172.21.15.155:6789/0 conn(0x7f6fd00ca610 legacy=0x7f6fd0072960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fced9d640 1 -- 172.21.15.155:0/2634465054 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd01583a0 con 0x7f6fd0151e70 2024-04-25T13:17:10.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.122+0000 7f6fced9d640 1 --2- 172.21.15.155:0/2634465054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd0151e70 0x7f6fd00cd890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097d0 tx=0x7f6fc402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15745ec74023d3d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4037070 con 0x7f6fd0151e70 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc4032440 con 0x7f6fd0151e70 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fcdd9b640 1 -- 172.21.15.155:0/2634465054 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40327f0 con 0x7f6fd0151e70 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 -- 172.21.15.155:0/2634465054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd0151e70 msgr2=0x7f6fd00cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2634465054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd0151e70 0x7f6fd00cd890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097d0 tx=0x7f6fc402a210 comp rx=0 tx=0).stop 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 -- 172.21.15.155:0/2634465054 shutdown_connections 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2634465054 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd0151e70 0x7f6fd00cd890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 -- 172.21.15.155:0/2634465054 >> 172.21.15.155:0/2634465054 conn(0x7f6fd006b920 msgr2=0x7f6fd006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 -- 172.21.15.155:0/2634465054 shutdown_connections 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.123+0000 7f6fd5091640 1 -- 172.21.15.155:0/2634465054 wait complete. 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 Processor -- start 2024-04-25T13:17:10.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 -- start start 2024-04-25T13:17:10.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fd00c88f0 0x7f6fd01480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd00ca610 0x7f6fd01525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 0x7f6fd01f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0152250 con 0x7f6fd0151e70 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0158920 con 0x7f6fd00c88f0 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.125+0000 7f6fd5091640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd01523d0 con 0x7f6fd00ca610 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 0x7f6fd01f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fced9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fd00c88f0 0x7f6fd01480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 0x7f6fd01f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52368/0 (socket says 172.21.15.155:52368) 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 -- 172.21.15.155:0/2795629091 learned_addr learned my addr 172.21.15.155:0/2795629091 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fce59c640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd00ca610 0x7f6fd01525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 -- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd00ca610 msgr2=0x7f6fd01525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd00ca610 0x7f6fd01525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 -- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fd00c88f0 msgr2=0x7f6fd01480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fd00c88f0 0x7f6fd01480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 -- 172.21.15.155:0/2795629091 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd0154720 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fce59c640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd00ca610 0x7f6fd01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fced9d640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fd00c88f0 0x7f6fd01480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fcf59e640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 0x7f6fd01f2350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800cbb0 tx=0x7f6fc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8017070 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc800aca0 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8012640 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd01e1f30 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.126+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd0154990 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.127+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd006c8b0 con 0x7f6fd0151e70 2024-04-25T13:17:10.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.128+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fc801a070 con 0x7f6fd0151e70 2024-04-25T13:17:10.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.128+0000 7f6fb77fe640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.128+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6fc808bc60 con 0x7f6fd0151e70 2024-04-25T13:17:10.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.128+0000 7f6fced9d640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.130 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.128+0000 7f6fced9d640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4034000 tx=0x7f6fc402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.132+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fc8059640 con 0x7f6fd0151e70 2024-04-25T13:17:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.343+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fd0151690 con 0x7f6fd0151e70 2024-04-25T13:17:10.343 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.344+0000 7f6fb77fe640 1 -- 172.21.15.155:0/2795629091 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6922 (secure 0 0 0) 0x7f6fc808b070 con 0x7f6fd0151e70 2024-04-25T13:17:10.344 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:10.344 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:17:05.822528+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4305,"mds_1":4297,"mds_2":4284,"mds_3":4282,"mds_4":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"c","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305,4297,4284,4282]},"id":1}]} 2024-04-25T13:17:10.344 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 17 2024-04-25T13:17:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6fbc06c8f0 msgr2=0x7f6fbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4034000 tx=0x7f6fc402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 msgr2=0x7f6fd01f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 0x7f6fd01f2350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800cbb0 tx=0x7f6fc800a060 comp rx=0 tx=0).stop 2024-04-25T13:17:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 shutdown_connections 2024-04-25T13:17:10.346 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fd0151e70 0x7f6fd01f2350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6fd00ca610 0x7f6fd01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 --2- 172.21.15.155:0/2795629091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6fd00c88f0 0x7f6fd01480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 >> 172.21.15.155:0/2795629091 conn(0x7f6fd006b920 msgr2=0x7f6fd0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 shutdown_connections 2024-04-25T13:17:10.347 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.346+0000 7f6fd5091640 1 -- 172.21.15.155:0/2795629091 wait complete. 2024-04-25T13:17:10.357 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:10.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.454+0000 7fca302e8640 1 Processor -- start 2024-04-25T13:17:10.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.454+0000 7fca302e8640 1 -- start start 2024-04-25T13:17:10.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca302e8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca28074d50 0x7fca2815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca302e8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fca28075130 0x7fca28075560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca302e8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca280cdcb0 con 0x7fca2815f190 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca302e8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fca28075aa0 con 0x7fca28075130 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca302e8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fca280cdf70 con 0x7fca28074d50 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2d883640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fca2815f190 0x7fca280c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35344/0 (socket says 172.21.15.155:35344) 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2d883640 1 -- 172.21.15.155:0/1996619715 learned_addr learned my addr 172.21.15.155:0/1996619715 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e084640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca28074d50 0x7fca2815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e885640 1 --2- 172.21.15.155:0/1996619715 >> v2:172.21.15.191:3300/0 conn(0x7fca28075130 0x7fca28075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2d082640 1 -- 172.21.15.155:0/1996619715 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115936766 0 0) 0x7fca280cdcb0 con 0x7fca2815f190 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2d082640 1 -- 172.21.15.155:0/1996619715 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca14003520 con 0x7fca2815f190 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e885640 1 -- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca28074d50 msgr2=0x7fca2815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e885640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca28074d50 0x7fca2815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e885640 1 -- 172.21.15.155:0/1996619715 >> v1:172.21.15.155:6789/0 conn(0x7fca2815f190 legacy=0x7fca280c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.456 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e885640 1 -- 172.21.15.155:0/1996619715 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca280ce250 con 0x7fca28075130 2024-04-25T13:17:10.457 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.455+0000 7fca2e084640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca28074d50 0x7fca2815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.456+0000 7fca2e885640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28075130 0x7fca28075560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca20009d90 tx=0x7fca2002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76bad9896f560047 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.456+0000 7fca2d082640 1 -- 172.21.15.155:0/1996619715 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20007740 con 0x7fca28075130 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.456+0000 7fca2d082640 1 -- 172.21.15.155:0/1996619715 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca200078e0 con 0x7fca28075130 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.456+0000 7fca2d082640 1 -- 172.21.15.155:0/1996619715 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20007cb0 con 0x7fca28075130 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 -- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28075130 msgr2=0x7fca28075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28075130 0x7fca28075560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca20009d90 tx=0x7fca2002a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 -- 172.21.15.155:0/1996619715 shutdown_connections 2024-04-25T13:17:10.458 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28075130 0x7fca28075560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 --2- 172.21.15.155:0/1996619715 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca28074d50 0x7fca2815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 -- 172.21.15.155:0/1996619715 >> 172.21.15.155:0/1996619715 conn(0x7fca2806b920 msgr2=0x7fca2806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 -- 172.21.15.155:0/1996619715 shutdown_connections 2024-04-25T13:17:10.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.457+0000 7fca302e8640 1 -- 172.21.15.155:0/1996619715 wait complete. 2024-04-25T13:17:10.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.458+0000 7fca302e8640 1 Processor -- start 2024-04-25T13:17:10.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.458+0000 7fca302e8640 1 -- start start 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.458+0000 7fca302e8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 0x7fca281e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 0x7fca281e4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2815f190 0x7fca281e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca2815ec70 con 0x7fca28075130 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fca2815e990 con 0x7fca28074d50 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fca280cd4b0 con 0x7fca2815f190 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 0x7fca281e4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2e084640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 0x7fca281e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 0x7fca281e4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52370/0 (socket says 172.21.15.155:52370) 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2e084640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 0x7fca281e43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:56646/0 (socket says 172.21.15.155:56646) 2024-04-25T13:17:10.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 -- 172.21.15.155:0/3836940067 learned_addr learned my addr 172.21.15.155:0/3836940067 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2e885640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2815f190 0x7fca281e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 -- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2815f190 msgr2=0x7fca281e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2815f190 0x7fca281e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 -- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 msgr2=0x7fca281e43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 0x7fca281e43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 -- 172.21.15.155:0/3836940067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca28141eb0 con 0x7fca28075130 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2e084640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 0x7fca281e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca2d883640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 0x7fca281e4900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c430 tx=0x7fca1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18017070 con 0x7fca28075130 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca18005ce0 con 0x7fca28075130 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca281561c0 con 0x7fca28075130 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180072f0 con 0x7fca28075130 2024-04-25T13:17:10.463 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.459+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca28156780 con 0x7fca28075130 2024-04-25T13:17:10.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.460+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca28068e40 con 0x7fca28075130 2024-04-25T13:17:10.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.461+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca1801a070 con 0x7fca28075130 2024-04-25T13:17:10.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.461+0000 7fca1effd640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fca0c06c920 0x7fca0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.461+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fca1808b300 con 0x7fca28075130 2024-04-25T13:17:10.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.461+0000 7fca2e084640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fca0c06c920 0x7fca0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.462+0000 7fca2e084640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fca0c06c920 0x7fca0c06ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca24009560 tx=0x7fca24009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.466+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fca18058cf0 con 0x7fca28075130 2024-04-25T13:17:10.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.643+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca280ce490 con 0x7fca28075130 2024-04-25T13:17:10.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.645+0000 7fca1effd640 1 -- 172.21.15.155:0/3836940067 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7fca18082e20 con 0x7fca28075130 2024-04-25T13:17:10.645 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:10.645 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.646+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fca0c06c920 msgr2=0x7fca0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.646+0000 7fca302e8640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fca0c06c920 0x7fca0c06ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca24009560 tx=0x7fca24009190 comp rx=0 tx=0).stop 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.646+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 msgr2=0x7fca281e4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.646+0000 7fca302e8640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 0x7fca281e4900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca1800c430 tx=0x7fca1800c8f0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 shutdown_connections 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fca0c06c920 0x7fca0c06ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fca2815f190 0x7fca281e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca28075130 0x7fca281e4900 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 --2- 172.21.15.155:0/3836940067 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fca28074d50 0x7fca281e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 >> 172.21.15.155:0/3836940067 conn(0x7fca2806b920 msgr2=0x7fca28143080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 shutdown_connections 2024-04-25T13:17:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.647+0000 7fca302e8640 1 -- 172.21.15.155:0/3836940067 wait complete. 2024-04-25T13:17:10.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:19.529860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:19.949095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:23.675819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:10.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:10.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.758+0000 7fa92123c640 1 Processor -- start 2024-04-25T13:17:10.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.758+0000 7fa92123c640 1 -- start start 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa92123c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa91c06cc00 0x7fa91c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa92123c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa91c06cfe0 0x7fa91c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa92123c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa91c15f500 con 0x7fa91c0cbc00 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa92123c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa91c0cd140 con 0x7fa91c06cfe0 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa92123c640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa91c15b190 con 0x7fa91c06cc00 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa91c06cfe0 0x7fa91c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa91c06cfe0 0x7fa91c154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52372/0 (socket says 172.21.15.155:52372) 2024-04-25T13:17:10.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 -- 172.21.15.155:0/3524381806 learned_addr learned my addr 172.21.15.155:0/3524381806 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:10.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91ad9d640 1 --2- 172.21.15.155:0/3524381806 >> v2:172.21.15.191:3300/0 conn(0x7fa91c06cc00 0x7fa91c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 -- 172.21.15.155:0/3524381806 >> v2:172.21.15.191:3300/0 conn(0x7fa91c06cc00 msgr2=0x7fa91c15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:10.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 --2- 172.21.15.155:0/3524381806 >> v2:172.21.15.191:3300/0 conn(0x7fa91c06cc00 0x7fa91c15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 -- 172.21.15.155:0/3524381806 >> v1:172.21.15.191:6789/0 conn(0x7fa91c0cbc00 legacy=0x7fa91c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.759+0000 7fa91a59c640 1 -- 172.21.15.155:0/3524381806 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c15b470 con 0x7fa91c06cfe0 2024-04-25T13:17:10.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.760+0000 7fa91a59c640 1 --2- 172.21.15.155:0/3524381806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cfe0 0x7fa91c154f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9100098a0 tx=0x7fa91002a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f30461437d227aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.760+0000 7fa919d9b640 1 -- 172.21.15.155:0/3524381806 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910037070 con 0x7fa91c06cfe0 2024-04-25T13:17:10.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.760+0000 7fa919d9b640 1 -- 172.21.15.155:0/3524381806 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa910032640 con 0x7fa91c06cfe0 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.760+0000 7fa919d9b640 1 -- 172.21.15.155:0/3524381806 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910032a10 con 0x7fa91c06cfe0 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 -- 172.21.15.155:0/3524381806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cfe0 msgr2=0x7fa91c154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 --2- 172.21.15.155:0/3524381806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cfe0 0x7fa91c154f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9100098a0 tx=0x7fa91002a370 comp rx=0 tx=0).stop 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 -- 172.21.15.155:0/3524381806 shutdown_connections 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 --2- 172.21.15.155:0/3524381806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cfe0 0x7fa91c154f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 --2- 172.21.15.155:0/3524381806 >> v2:172.21.15.191:3300/0 conn(0x7fa91c06cc00 0x7fa91c15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 -- 172.21.15.155:0/3524381806 >> 172.21.15.155:0/3524381806 conn(0x7fa91c075570 msgr2=0x7fa91c073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 -- 172.21.15.155:0/3524381806 shutdown_connections 2024-04-25T13:17:10.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.761+0000 7fa92123c640 1 -- 172.21.15.155:0/3524381806 wait complete. 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.762+0000 7fa92123c640 1 Processor -- start 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.762+0000 7fa92123c640 1 -- start start 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa92123c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 0x7fa91c0b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa92123c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa91c06cfe0 0x7fa91c0c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa92123c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa91c0cbc00 0x7fa91c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa92123c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c15bd10 con 0x7fa91c06cc00 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa92123c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c15ba30 con 0x7fa91c0cbc00 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa92123c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa91c0c6010 con 0x7fa91c06cfe0 2024-04-25T13:17:10.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 0x7fa91c0b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 0x7fa91c0b5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52382/0 (socket says 172.21.15.155:52382) 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 -- 172.21.15.155:0/1705375019 learned_addr learned my addr 172.21.15.155:0/1705375019 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91b59e640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa91c0cbc00 0x7fa91c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91a59c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa91c06cfe0 0x7fa91c0c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 -- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa91c06cfe0 msgr2=0x7fa91c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa91c06cfe0 0x7fa91c0c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 -- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa91c0cbc00 msgr2=0x7fa91c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa91c0cbc00 0x7fa91c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 -- 172.21.15.155:0/1705375019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c0c81d0 con 0x7fa91c06cc00 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.763+0000 7fa91ad9d640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 0x7fa91c0b5d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00efc0 tx=0x7fa90c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.764+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c018020 con 0x7fa91c06cc00 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.764+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91c15e6a0 con 0x7fa91c06cc00 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.764+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c014480 con 0x7fa91c06cc00 2024-04-25T13:17:10.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.764+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c014850 con 0x7fa91c06cc00 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.764+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91c0c6cd0 con 0x7fa91c06cc00 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.765+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91c068f50 con 0x7fa91c06cc00 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.765+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa90c005d10 con 0x7fa91c06cc00 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.765+0000 7fa9037fe640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa90806c8f0 0x7fa90806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.766+0000 7fa91a59c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa90806c8f0 0x7fa90806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.766+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa90c08ca20 con 0x7fa91c06cc00 2024-04-25T13:17:10.768 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.766+0000 7fa91a59c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa90806c8f0 0x7fa90806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa910034000 tx=0x7fa91002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:10.770 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.770+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa90c022070 con 0x7fa91c06cc00 2024-04-25T13:17:10.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.953+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa91c0cc2b0 con 0x7fa91c06cc00 2024-04-25T13:17:10.954 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.954+0000 7fa9037fe640 1 -- 172.21.15.155:0/1705375019 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa90c010040 con 0x7fa91c06cc00 2024-04-25T13:17:10.954 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa90806c8f0 msgr2=0x7fa90806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa90806c8f0 0x7fa90806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa910034000 tx=0x7fa91002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 msgr2=0x7fa91c0b5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 0x7fa91c0b5d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00efc0 tx=0x7fa90c00c490 comp rx=0 tx=0).stop 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 shutdown_connections 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa91c0cbc00 0x7fa91c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa90806c8f0 0x7fa90806edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa91c06cfe0 0x7fa91c0c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 --2- 172.21.15.155:0/1705375019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa91c06cc00 0x7fa91c0b5d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:10.956 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.955+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 >> 172.21.15.155:0/1705375019 conn(0x7fa91c075570 msgr2=0x7fa91c0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:10.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.956+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 shutdown_connections 2024-04-25T13:17:10.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:10.956+0000 7fa92123c640 1 -- 172.21.15.155:0/1705375019 wait complete. 2024-04-25T13:17:10.967 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:11.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.077+0000 7f35e9ea0640 1 Processor -- start 2024-04-25T13:17:11.077 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.077+0000 7f35e9ea0640 1 -- start start 2024-04-25T13:17:11.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e9ea0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35e40cd0f0 0x7f35e40cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e9ea0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e40d1510 con 0x7f35e41554e0 2024-04-25T13:17:11.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e9ea0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e415b5d0 con 0x7f35e40cc6f0 2024-04-25T13:17:11.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e9ea0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f35e40cced0 con 0x7f35e40cd0f0 2024-04-25T13:17:11.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35e40cd0f0 0x7f35e40cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e37fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f35e41554e0 0x7f35e40d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:35358/0 (socket says 172.21.15.155:35358) 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35e40cd0f0 0x7f35e40cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52396/0 (socket says 172.21.15.155:52396) 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e37fe640 1 -- 172.21.15.155:0/2339778289 learned_addr learned my addr 172.21.15.155:0/2339778289 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e3fff640 1 -- 172.21.15.155:0/2339778289 >> v1:172.21.15.191:6789/0 conn(0x7f35e40cc6f0 legacy=0x7f35e40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e3fff640 1 -- 172.21.15.155:0/2339778289 >> v1:172.21.15.155:6789/0 conn(0x7f35e41554e0 legacy=0x7f35e40d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.078+0000 7f35e3fff640 1 -- 172.21.15.155:0/2339778289 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e415b8b0 con 0x7f35e40cd0f0 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.079+0000 7f35e3fff640 1 --2- 172.21.15.155:0/2339778289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e40cd0f0 0x7f35e40cd500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009d90 tx=0x7f35dc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e72e07a7614e9fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.079+0000 7f35e27fc640 1 -- 172.21.15.155:0/2339778289 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc007740 con 0x7f35e40cd0f0 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.079+0000 7f35e27fc640 1 -- 172.21.15.155:0/2339778289 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35dc0078e0 con 0x7f35e40cd0f0 2024-04-25T13:17:11.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.079+0000 7f35e27fc640 1 -- 172.21.15.155:0/2339778289 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc007cb0 con 0x7f35e40cd0f0 2024-04-25T13:17:11.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 -- 172.21.15.155:0/2339778289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e40cd0f0 msgr2=0x7f35e40cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/2339778289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e40cd0f0 0x7f35e40cd500 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009d90 tx=0x7f35dc02a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 -- 172.21.15.155:0/2339778289 shutdown_connections 2024-04-25T13:17:11.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/2339778289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e40cd0f0 0x7f35e40cd500 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 -- 172.21.15.155:0/2339778289 >> 172.21.15.155:0/2339778289 conn(0x7f35e4074d50 msgr2=0x7f35e4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.081 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 -- 172.21.15.155:0/2339778289 shutdown_connections 2024-04-25T13:17:11.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.080+0000 7f35e9ea0640 1 -- 172.21.15.155:0/2339778289 wait complete. 2024-04-25T13:17:11.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.081+0000 7f35e9ea0640 1 Processor -- start 2024-04-25T13:17:11.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.081+0000 7f35e9ea0640 1 -- start start 2024-04-25T13:17:11.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e9ea0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e40cc6f0 0x7f35e40c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e9ea0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35e40cd0f0 0x7f35e4153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e9ea0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 0x7f35e41f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e9ea0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40cda40 con 0x7f35e41554e0 2024-04-25T13:17:11.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e9ea0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f35e415bf00 con 0x7f35e40cc6f0 2024-04-25T13:17:11.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e9ea0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f35e40d11e0 con 0x7f35e40cd0f0 2024-04-25T13:17:11.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 0x7f35e41f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 0x7f35e41f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52408/0 (socket says 172.21.15.155:52408) 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 -- 172.21.15.155:0/261923461 learned_addr learned my addr 172.21.15.155:0/261923461 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e37fe640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e40cc6f0 0x7f35e40c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e2ffd640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35e40cd0f0 0x7f35e4153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 -- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35e40cd0f0 msgr2=0x7f35e4153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35e40cd0f0 0x7f35e4153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 -- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e40cc6f0 msgr2=0x7f35e40c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e40cc6f0 0x7f35e40c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 -- 172.21.15.155:0/261923461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e40c8c80 con 0x7f35e41554e0 2024-04-25T13:17:11.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.082+0000 7f35e3fff640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 0x7f35e41f0ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009eb0 tx=0x7f35dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.083+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc040070 con 0x7f35e41554e0 2024-04-25T13:17:11.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.083+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35dc031c90 con 0x7f35e41554e0 2024-04-25T13:17:11.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.083+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e415a750 con 0x7f35e41554e0 2024-04-25T13:17:11.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.083+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc045680 con 0x7f35e41554e0 2024-04-25T13:17:11.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.083+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e40c8480 con 0x7f35e41554e0 2024-04-25T13:17:11.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.084+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e4068e40 con 0x7f35e41554e0 2024-04-25T13:17:11.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.084+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35dc039040 con 0x7f35e41554e0 2024-04-25T13:17:11.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.085+0000 7f35cbfff640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35d006c8f0 0x7f35d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.085+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f35dc0ad9a0 con 0x7f35e41554e0 2024-04-25T13:17:11.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.085+0000 7f35e37fe640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35d006c8f0 0x7f35d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.085+0000 7f35e37fe640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35d006c8f0 0x7f35d006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35d4005880 tx=0x7f35d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.089+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35dc043360 con 0x7f35e41554e0 2024-04-25T13:17:11.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.263+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f35e40cc390 con 0x7f35e41554e0 2024-04-25T13:17:11.263 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.263+0000 7f35cbfff640 1 -- 172.21.15.155:0/261923461 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f35dc07ba00 con 0x7f35e41554e0 2024-04-25T13:17:11.264 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35d006c8f0 msgr2=0x7f35d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35d006c8f0 0x7f35d006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35d4005880 tx=0x7f35d4009040 comp rx=0 tx=0).stop 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 msgr2=0x7f35e41f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 0x7f35e41f0ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009eb0 tx=0x7f35dc004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 shutdown_connections 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35e41554e0 0x7f35e41f0ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f35d006c8f0 0x7f35d006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f35e40cd0f0 0x7f35e4153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 --2- 172.21.15.155:0/261923461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e40cc6f0 0x7f35e40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 >> 172.21.15.155:0/261923461 conn(0x7f35e4074d50 msgr2=0x7f35e40cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 shutdown_connections 2024-04-25T13:17:11.266 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.265+0000 7f35e9ea0640 1 -- 172.21.15.155:0/261923461 wait complete. 2024-04-25T13:17:11.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:11.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.377+0000 7f6350976640 1 Processor -- start 2024-04-25T13:17:11.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.377+0000 7f6350976640 1 -- start start 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f6350976640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f634c0c8340 0x7f634c0723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f6350976640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f634c158b10 0x7f634c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f6350976640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634c157d70 con 0x7f634c0c8720 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f6350976640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f634c158680 con 0x7f634c0c8340 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f6350976640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f634c15be10 con 0x7f634c158b10 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f634a59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f634c0c8340 0x7f634c0723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f634a59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f634c0c8340 0x7f634c0723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52414/0 (socket says 172.21.15.155:52414) 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.378+0000 7f634a59c640 1 -- 172.21.15.155:0/3860092116 learned_addr learned my addr 172.21.15.155:0/3860092116 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f6341d9b640 1 --2- 172.21.15.155:0/3860092116 >> v2:172.21.15.191:3300/0 conn(0x7f634c158b10 0x7f634c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f634a59c640 1 -- 172.21.15.155:0/3860092116 >> v2:172.21.15.191:3300/0 conn(0x7f634c158b10 msgr2=0x7f634c15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f634a59c640 1 --2- 172.21.15.155:0/3860092116 >> v2:172.21.15.191:3300/0 conn(0x7f634c158b10 0x7f634c15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f634a59c640 1 -- 172.21.15.155:0/3860092116 >> v1:172.21.15.155:6789/0 conn(0x7f634c0c8720 legacy=0x7f634c151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f634a59c640 1 -- 172.21.15.155:0/3860092116 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c15c0f0 con 0x7f634c0c8340 2024-04-25T13:17:11.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f634a59c640 1 --2- 172.21.15.155:0/3860092116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c0723b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f634c0c94c0 tx=0x7f633c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df325d294a3e9fee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.379+0000 7f6349d9b640 1 -- 172.21.15.155:0/3860092116 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c036020 con 0x7f634c0c8340 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6349d9b640 1 -- 172.21.15.155:0/3860092116 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c032640 con 0x7f634c0c8340 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6349d9b640 1 -- 172.21.15.155:0/3860092116 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c032a10 con 0x7f634c0c8340 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 -- 172.21.15.155:0/3860092116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 msgr2=0x7f634c0723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 --2- 172.21.15.155:0/3860092116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c0723b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f634c0c94c0 tx=0x7f633c02c940 comp rx=0 tx=0).stop 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 -- 172.21.15.155:0/3860092116 shutdown_connections 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 --2- 172.21.15.155:0/3860092116 >> v2:172.21.15.191:3300/0 conn(0x7f634c158b10 0x7f634c15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 --2- 172.21.15.155:0/3860092116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c0723b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 -- 172.21.15.155:0/3860092116 >> 172.21.15.155:0/3860092116 conn(0x7f634c06d660 msgr2=0x7f634c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 -- 172.21.15.155:0/3860092116 shutdown_connections 2024-04-25T13:17:11.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.380+0000 7f6350976640 1 -- 172.21.15.155:0/3860092116 wait complete. 2024-04-25T13:17:11.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 Processor -- start 2024-04-25T13:17:11.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 -- start start 2024-04-25T13:17:11.383 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c1f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0c8720 0x7f634c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c158b10 0x7f634c1f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f634c0728f0 con 0x7f634c0c8340 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f634c158310 con 0x7f634c0c8720 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f6350976640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f634c152220 con 0x7f634c158b10 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f634a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c1f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f634a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c1f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52418/0 (socket says 172.21.15.155:52418) 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.382+0000 7f634a59c640 1 -- 172.21.15.155:0/1150357066 learned_addr learned my addr 172.21.15.155:0/1150357066 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f6341d9b640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0c8720 0x7f634c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634ad9d640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c158b10 0x7f634c1f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634a59c640 1 -- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c158b10 msgr2=0x7f634c1f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634a59c640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c158b10 0x7f634c1f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634a59c640 1 -- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0c8720 msgr2=0x7f634c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634a59c640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0c8720 0x7f634c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.384 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634a59c640 1 -- 172.21.15.155:0/1150357066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c15a0f0 con 0x7f634c0c8340 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f6341d9b640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0c8720 0x7f634c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634ad9d640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c158b10 0x7f634c1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f634a59c640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c1f4c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f633c02c980 tx=0x7f633c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c036040 con 0x7f634c0c8340 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c031af0 con 0x7f634c0c8340 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c15a3d0 con 0x7f634c0c8340 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c044480 con 0x7f634c0c8340 2024-04-25T13:17:11.385 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.383+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c15ae30 con 0x7f634c0c8340 2024-04-25T13:17:11.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.384+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634c068f50 con 0x7f634c0c8340 2024-04-25T13:17:11.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.384+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f633c039020 con 0x7f634c0c8340 2024-04-25T13:17:11.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.385+0000 7f63437fe640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f632c06c8f0 0x7f632c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.385+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f633c0ac790 con 0x7f634c0c8340 2024-04-25T13:17:11.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.385+0000 7f6341d9b640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f632c06c8f0 0x7f632c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.386 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.385+0000 7f6341d9b640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f632c06c8f0 0x7f632c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f634c150ee0 tx=0x7f6334008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.389+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f633c04b070 con 0x7f634c0c8340 2024-04-25T13:17:11.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.564+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f634c071830 con 0x7f634c0c8340 2024-04-25T13:17:11.564 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.564+0000 7f63437fe640 1 -- 172.21.15.155:0/1150357066 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f633c07a6b0 con 0x7f634c0c8340 2024-04-25T13:17:11.564 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f632c06c8f0 msgr2=0x7f632c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f632c06c8f0 0x7f632c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f634c150ee0 tx=0x7f6334008040 comp rx=0 tx=0).stop 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 msgr2=0x7f634c1f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c1f4c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f633c02c980 tx=0x7f633c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 shutdown_connections 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f632c06c8f0 0x7f632c06edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f634c158b10 0x7f634c1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f634c0c8720 0x7f634c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 --2- 172.21.15.155:0/1150357066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f634c0c8340 0x7f634c1f4c80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 >> 172.21.15.155:0/1150357066 conn(0x7f634c06d660 msgr2=0x7f634c149280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 shutdown_connections 2024-04-25T13:17:11.568 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.567+0000 7f6350976640 1 -- 172.21.15.155:0/1150357066 wait complete. 2024-04-25T13:17:11.578 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:11.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.678+0000 7f010ebe2640 1 Processor -- start 2024-04-25T13:17:11.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.678+0000 7f010ebe2640 1 -- start start 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.678+0000 7f010ebe2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f010815ea20 0x7f010815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.678+0000 7f010ebe2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0108071c40 con 0x7f010806b920 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.678+0000 7f010ebe2640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010806c4a0 con 0x7f0108155130 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.678+0000 7f010ebe2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f010815e590 con 0x7f010815ea20 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.679+0000 7f0107fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f010815ea20 0x7f010815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.679+0000 7f0107fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f010815ea20 0x7f010815ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52426/0 (socket says 172.21.15.155:52426) 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.679+0000 7f0107fff640 1 -- 172.21.15.155:0/1060998401 learned_addr learned my addr 172.21.15.155:0/1060998401 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.679+0000 7f0107fff640 1 -- 172.21.15.155:0/1060998401 >> v1:172.21.15.191:6789/0 conn(0x7f0108155130 legacy=0x7f01080cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.679+0000 7f0107fff640 1 -- 172.21.15.155:0/1060998401 >> v1:172.21.15.155:6789/0 conn(0x7f010806b920 legacy=0x7f010806bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.679+0000 7f0107fff640 1 -- 172.21.15.155:0/1060998401 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010815afa0 con 0x7f010815ea20 2024-04-25T13:17:11.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f0107fff640 1 --2- 172.21.15.155:0/1060998401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f010815ee60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009e50 tx=0x7f00f802a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48d9748a55c667 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f01077fe640 1 -- 172.21.15.155:0/1060998401 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f8036070 con 0x7f010815ea20 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f01077fe640 1 -- 172.21.15.155:0/1060998401 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f8031600 con 0x7f010815ea20 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f01077fe640 1 -- 172.21.15.155:0/1060998401 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f80319d0 con 0x7f010815ea20 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 -- 172.21.15.155:0/1060998401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 msgr2=0x7f010815ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 --2- 172.21.15.155:0/1060998401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f010815ee60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009e50 tx=0x7f00f802a7f0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 -- 172.21.15.155:0/1060998401 shutdown_connections 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 --2- 172.21.15.155:0/1060998401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f010815ee60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 -- 172.21.15.155:0/1060998401 >> 172.21.15.155:0/1060998401 conn(0x7f0108074f30 msgr2=0x7f0108075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 -- 172.21.15.155:0/1060998401 shutdown_connections 2024-04-25T13:17:11.681 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.680+0000 7f010ebe2640 1 -- 172.21.15.155:0/1060998401 wait complete. 2024-04-25T13:17:11.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.681+0000 7f010ebe2640 1 Processor -- start 2024-04-25T13:17:11.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.681+0000 7f010ebe2640 1 -- start start 2024-04-25T13:17:11.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010ebe2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010806b920 0x7f010815da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010ebe2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0108155130 0x7f010814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010ebe2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f01081f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010ebe2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f010815b540 con 0x7f010815ea20 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010ebe2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f010815b260 con 0x7f0108155130 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010ebe2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f010815b820 con 0x7f010806b920 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010d17f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f01081f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010d17f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f01081f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52442/0 (socket says 172.21.15.155:52442) 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.682+0000 7f010d17f640 1 -- 172.21.15.155:0/2415509841 learned_addr learned my addr 172.21.15.155:0/2415509841 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f0107fff640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0108155130 0x7f010814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010c97e640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010806b920 0x7f010815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010d17f640 1 -- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010806b920 msgr2=0x7f010815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010d17f640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010806b920 0x7f010815da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010d17f640 1 -- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0108155130 msgr2=0x7f010814e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010d17f640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0108155130 0x7f010814e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010d17f640 1 -- 172.21.15.155:0/2415509841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01081f57d0 con 0x7f010815ea20 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f0107fff640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0108155130 0x7f010814e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010d17f640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f01081f2d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f00f000c3f0 tx=0x7f00f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0017070 con 0x7f010815ea20 2024-04-25T13:17:11.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f00052d0 con 0x7f010815ea20 2024-04-25T13:17:11.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01081f4c50 con 0x7f010815ea20 2024-04-25T13:17:11.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0003850 con 0x7f010815ea20 2024-04-25T13:17:11.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.683+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01081f5210 con 0x7f010815ea20 2024-04-25T13:17:11.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.684+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0108068e40 con 0x7f010815ea20 2024-04-25T13:17:11.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.684+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00f001a070 con 0x7f010815ea20 2024-04-25T13:17:11.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.685+0000 7f01057fa640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f00e806c8f0 0x7f00e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.685+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f00f008b350 con 0x7f010815ea20 2024-04-25T13:17:11.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.685+0000 7f010c97e640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f00e806c8f0 0x7f00e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.686 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.685+0000 7f010c97e640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f00e806c8f0 0x7f00e806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0100003d90 tx=0x7f0100009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.689 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.689+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0108071c40 con 0x7f010815ea20 2024-04-25T13:17:11.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.865+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0108153e80 con 0x7f010815ea20 2024-04-25T13:17:11.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.866+0000 7f01057fa640 1 -- 172.21.15.155:0/2415509841 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f00f00592f0 con 0x7f010815ea20 2024-04-25T13:17:11.866 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f00e806c8f0 msgr2=0x7f00e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f00e806c8f0 0x7f00e806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0100003d90 tx=0x7f0100009040 comp rx=0 tx=0).stop 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 msgr2=0x7f01081f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f01081f2d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f00f000c3f0 tx=0x7f00f000c8b0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 shutdown_connections 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010815ea20 0x7f01081f2d60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0108155130 0x7f010814e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f00e806c8f0 0x7f00e806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 --2- 172.21.15.155:0/2415509841 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f010806b920 0x7f010815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 >> 172.21.15.155:0/2415509841 conn(0x7f0108074f30 msgr2=0x7f01080c8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 shutdown_connections 2024-04-25T13:17:11.869 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.868+0000 7f010ebe2640 1 -- 172.21.15.155:0/2415509841 wait complete. 2024-04-25T13:17:11.879 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:11.914 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:11.924 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:11.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.977+0000 7f4ad8f68640 1 Processor -- start 2024-04-25T13:17:11.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.977+0000 7f4ad8f68640 1 -- start start 2024-04-25T13:17:11.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad8f68640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 0x7f4ad415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad8f68640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 0x7f4ad40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad8f68640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad41558c0 con 0x7f4ad40b5450 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad8f68640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad40b4a80 con 0x7f4ad41554e0 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad8f68640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad415f630 con 0x7f4ad40b3c00 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad1d9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 0x7f4ad40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad259c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 0x7f4ad415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad2d9d640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f4ad40b5450 0x7f4ad40d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:53756/0 (socket says 172.21.15.155:53756) 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad1d9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 0x7f4ad40b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:46840/0 (socket says 172.21.15.155:46840) 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad259c640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 0x7f4ad415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:56712/0 (socket says 172.21.15.155:56712) 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.978+0000 7f4ad2d9d640 1 -- 172.21.15.155:0/3469720463 learned_addr learned my addr 172.21.15.155:0/3469720463 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad1d9b640 1 -- 172.21.15.155:0/3469720463 >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 msgr2=0x7f4ad415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad1d9b640 1 --2- 172.21.15.155:0/3469720463 >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 0x7f4ad415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad1d9b640 1 -- 172.21.15.155:0/3469720463 >> v1:172.21.15.191:6789/0 conn(0x7f4ad40b5450 legacy=0x7f4ad40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad159a640 1 -- 172.21.15.155:0/3469720463 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915024595 0 0) 0x7f4acc001490 con 0x7f4ad40b5450 2024-04-25T13:17:11.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad1d9b640 1 -- 172.21.15.155:0/3469720463 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad40cb8c0 con 0x7f4ad40b3c00 2024-04-25T13:17:11.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad259c640 1 --2- 172.21.15.155:0/3469720463 >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 0x7f4ad415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad1d9b640 1 --2- 172.21.15.155:0/3469720463 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 0x7f4ad40b4f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097a0 tx=0x7f4ac802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d72f752b7cb08e4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad159a640 1 -- 172.21.15.155:0/3469720463 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8037070 con 0x7f4ad40b3c00 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad159a640 1 -- 172.21.15.155:0/3469720463 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8032440 con 0x7f4ad40b3c00 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.979+0000 7f4ad159a640 1 -- 172.21.15.155:0/3469720463 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8032810 con 0x7f4ad40b3c00 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 -- 172.21.15.155:0/3469720463 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 msgr2=0x7f4ad40b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/3469720463 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 0x7f4ad40b4f10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097a0 tx=0x7f4ac802a210 comp rx=0 tx=0).stop 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 -- 172.21.15.155:0/3469720463 shutdown_connections 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/3469720463 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad40b3c00 0x7f4ad40b4f10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/3469720463 >> v2:172.21.15.191:3300/0 conn(0x7f4ad41554e0 0x7f4ad415f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 -- 172.21.15.155:0/3469720463 >> 172.21.15.155:0/3469720463 conn(0x7f4ad4074d50 msgr2=0x7f4ad4075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:11.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 -- 172.21.15.155:0/3469720463 shutdown_connections 2024-04-25T13:17:11.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.980+0000 7f4ad8f68640 1 -- 172.21.15.155:0/3469720463 wait complete. 2024-04-25T13:17:11.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.981+0000 7f4ad8f68640 1 Processor -- start 2024-04-25T13:17:11.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.981+0000 7f4ad8f68640 1 -- start start 2024-04-25T13:17:11.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad8f68640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 0x7f4ad41f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad8f68640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ad40b5450 0x7f4ad41f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad8f68640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad41554e0 0x7f4ad415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad8f68640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad40b4430 con 0x7f4ad40b3c00 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad8f68640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad40b4150 con 0x7f4ad40b5450 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad8f68640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad40b4710 con 0x7f4ad41554e0 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 0x7f4ad41f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 0x7f4ad41f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:52458/0 (socket says 172.21.15.155:52458) 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 -- 172.21.15.155:0/129184726 learned_addr learned my addr 172.21.15.155:0/129184726 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad2d9d640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad41554e0 0x7f4ad415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad1d9b640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ad40b5450 0x7f4ad41f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 -- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad41554e0 msgr2=0x7f4ad415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad41554e0 0x7f4ad415e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 -- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ad40b5450 msgr2=0x7f4ad41f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:11.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ad40b5450 0x7f4ad41f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad259c640 1 -- 172.21.15.155:0/129184726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad4157860 con 0x7f4ad40b3c00 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.982+0000 7f4ad2d9d640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad41554e0 0x7f4ad415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.983+0000 7f4ad259c640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 0x7f4ad41f4e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400ec10 tx=0x7f4ac400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.983+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4017070 con 0x7f4ad40b3c00 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.983+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac400cc30 con 0x7f4ad40b3c00 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.983+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad4157b40 con 0x7f4ad40b3c00 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.983+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4013470 con 0x7f4ad40b3c00 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.983+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad41f4340 con 0x7f4ad40b3c00 2024-04-25T13:17:11.985 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.984+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad4075ac0 con 0x7f4ad40b3c00 2024-04-25T13:17:11.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.984+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ac401a070 con 0x7f4ad40b3c00 2024-04-25T13:17:11.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.985+0000 7f4ac2ffd640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4ab406c8f0 0x7f4ab406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:11.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.985+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4ac408be20 con 0x7f4ad40b3c00 2024-04-25T13:17:11.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.985+0000 7f4ad1d9b640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4ab406c8f0 0x7f4ab406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:11.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.985+0000 7f4ad1d9b640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4ab406c8f0 0x7f4ab406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034000 tx=0x7f4ac802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:11.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:11.989+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ad4075ac0 con 0x7f4ad40b3c00 2024-04-25T13:17:12.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.203+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ad40d0050 con 0x7f4ad40b3c00 2024-04-25T13:17:12.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.204+0000 7f4ac2ffd640 1 -- 172.21.15.155:0/129184726 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6926 (secure 0 0 0) 0x7f4ad40d0050 con 0x7f4ad40b3c00 2024-04-25T13:17:12.204 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:12.204 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:17:11.835312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4305,"mds_1":4297,"mds_2":4284,"mds_3":4282,"mds_4":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":16,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"c","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4278,4282,4284,4297,4305]},"id":1}]} 2024-04-25T13:17:12.205 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-04-25T13:17:12.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4ab406c8f0 msgr2=0x7f4ab406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4ab406c8f0 0x7f4ab406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034000 tx=0x7f4ac802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:12.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 msgr2=0x7f4ad41f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 0x7f4ad41f4e20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400ec10 tx=0x7f4ac400c520 comp rx=0 tx=0).stop 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 shutdown_connections 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4ab406c8f0 0x7f4ab406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4ad41554e0 0x7f4ad415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ad40b5450 0x7f4ad41f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 --2- 172.21.15.155:0/129184726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ad40b3c00 0x7f4ad41f4e20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 >> 172.21.15.155:0/129184726 conn(0x7f4ad4074d50 msgr2=0x7f4ad41527c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 shutdown_connections 2024-04-25T13:17:12.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.206+0000 7f4ad8f68640 1 -- 172.21.15.155:0/129184726 wait complete. 2024-04-25T13:17:12.217 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:12.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.355+0000 7fb76a043640 1 Processor -- start 2024-04-25T13:17:12.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.355+0000 7fb76a043640 1 -- start start 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.355+0000 7fb76a043640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb7640c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb76a043640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb7640c8870 0x7fb7640c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb76a043640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb764158fe0 con 0x7fb76415c4c0 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb76a043640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fb7641592c0 con 0x7fb7640c8870 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb76a043640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb7641595a0 con 0x7fb764152f70 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb7640c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb762ffd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fb7640c8870 0x7fb7640c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb7640c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:46862/0 (socket says 172.21.15.155:46862) 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 -- 172.21.15.155:0/1511990202 learned_addr learned my addr 172.21.15.155:0/1511990202 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:12.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb763fff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fb76415c4c0 0x7fb76415c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:53758/0 (socket says 172.21.15.155:53758) 2024-04-25T13:17:12.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 -- 172.21.15.155:0/1511990202 >> v2:172.21.15.191:3300/0 conn(0x7fb7640c8870 msgr2=0x7fb7640c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:12.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 --2- 172.21.15.155:0/1511990202 >> v2:172.21.15.191:3300/0 conn(0x7fb7640c8870 0x7fb7640c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 -- 172.21.15.155:0/1511990202 >> v1:172.21.15.191:6789/0 conn(0x7fb76415c4c0 legacy=0x7fb76415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.356+0000 7fb7637fe640 1 -- 172.21.15.155:0/1511990202 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb764159880 con 0x7fb764152f70 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.357+0000 7fb7637fe640 1 --2- 172.21.15.155:0/1511990202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb7640c5b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb754009870 tx=0x7fb75402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3b5e8a348b47b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.357+0000 7fb7627fc640 1 -- 172.21.15.155:0/1511990202 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb754037070 con 0x7fb764152f70 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.357+0000 7fb7627fc640 1 -- 172.21.15.155:0/1511990202 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb754032440 con 0x7fb764152f70 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.357+0000 7fb7627fc640 1 -- 172.21.15.155:0/1511990202 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb754032810 con 0x7fb764152f70 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.357+0000 7fb76a043640 1 -- 172.21.15.155:0/1511990202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 msgr2=0x7fb7640c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.357+0000 7fb76a043640 1 --2- 172.21.15.155:0/1511990202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb7640c5b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb754009870 tx=0x7fb75402a270 comp rx=0 tx=0).stop 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.358+0000 7fb76a043640 1 -- 172.21.15.155:0/1511990202 shutdown_connections 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.358+0000 7fb76a043640 1 --2- 172.21.15.155:0/1511990202 >> v2:172.21.15.191:3300/0 conn(0x7fb7640c8870 0x7fb7640c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.358+0000 7fb76a043640 1 --2- 172.21.15.155:0/1511990202 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb7640c5b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.358+0000 7fb76a043640 1 -- 172.21.15.155:0/1511990202 >> 172.21.15.155:0/1511990202 conn(0x7fb764074d50 msgr2=0x7fb764075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:12.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.358+0000 7fb76a043640 1 -- 172.21.15.155:0/1511990202 shutdown_connections 2024-04-25T13:17:12.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.358+0000 7fb76a043640 1 -- 172.21.15.155:0/1511990202 wait complete. 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 Processor -- start 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 -- start start 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7640c8870 0x7fb764156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb764143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 0x7fb7641587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7641534d0 con 0x7fb7640c8870 2024-04-25T13:17:12.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb764153350 con 0x7fb76415c4c0 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.359+0000 7fb76a043640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb764073a30 con 0x7fb764152f70 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 0x7fb7641587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb7637fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7640c8870 0x7fb764156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 0x7fb7641587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:56742/0 (socket says 172.21.15.155:56742) 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 -- 172.21.15.155:0/3111072706 learned_addr learned my addr 172.21.15.155:0/3111072706 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb762ffd640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb764143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 -- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 msgr2=0x7fb764143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb764143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 -- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7640c8870 msgr2=0x7fb764156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7640c8870 0x7fb764156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 -- 172.21.15.155:0/3111072706 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7641ef570 con 0x7fb76415c4c0 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb7637fe640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7640c8870 0x7fb764156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb762ffd640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb764143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:12.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb763fff640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 0x7fb7641587a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c730 tx=0x7fb75c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c017070 con 0x7fb76415c4c0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c00ce40 con 0x7fb76415c4c0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb764143330 con 0x7fb76415c4c0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00a840 con 0x7fb76415c4c0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.360+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7640cbef0 con 0x7fb76415c4c0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.361+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76414e1a0 con 0x7fb76415c4c0 2024-04-25T13:17:12.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.362+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb75c01a070 con 0x7fb76415c4c0 2024-04-25T13:17:12.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.362+0000 7fb74bfff640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb75006c920 0x7fb75006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.362+0000 7fb7637fe640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb75006c920 0x7fb75006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.362+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb75c08b5e0 con 0x7fb76415c4c0 2024-04-25T13:17:12.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.363+0000 7fb7637fe640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb75006c920 0x7fb75006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb754034000 tx=0x7fb75402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:12.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.371+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb76414e1a0 con 0x7fb76415c4c0 2024-04-25T13:17:12.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.546+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb764068e40 con 0x7fb76415c4c0 2024-04-25T13:17:12.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.547+0000 7fb74bfff640 1 -- 172.21.15.155:0/3111072706 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7fb75c059030 con 0x7fb76415c4c0 2024-04-25T13:17:12.547 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:12.547 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb75006c920 msgr2=0x7fb75006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb75006c920 0x7fb75006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb754034000 tx=0x7fb75402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 msgr2=0x7fb7641587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 0x7fb7641587a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c730 tx=0x7fb75c00cbf0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 shutdown_connections 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb76415c4c0 0x7fb7641587a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb75006c920 0x7fb75006ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb764152f70 0x7fb764143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 --2- 172.21.15.155:0/3111072706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7640c8870 0x7fb764156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 >> 172.21.15.155:0/3111072706 conn(0x7fb764074d50 msgr2=0x7fb76414d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:12.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 shutdown_connections 2024-04-25T13:17:12.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.549+0000 7fb76a043640 1 -- 172.21.15.155:0/3111072706 wait complete. 2024-04-25T13:17:12.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:12.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.658+0000 7f0e618e8640 1 Processor -- start 2024-04-25T13:17:12.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.658+0000 7f0e618e8640 1 -- start start 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e618e8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0e5c06bb90 0x7f0e5c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e618e8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e618e8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5c15bef0 con 0x7f0e5c0c99f0 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e618e8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5c15b650 con 0x7f0e5c06bb90 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e618e8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c15b930 con 0x7f0e5c06bf70 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5b7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f0e5c0c99f0 0x7f0e5c154db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55442/0 (socket says 172.21.15.155:55442) 2024-04-25T13:17:12.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5b7fe640 1 -- 172.21.15.155:0/1745941900 learned_addr learned my addr 172.21.15.155:0/1745941900 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5affd640 1 --2- 172.21.15.155:0/1745941900 >> v2:172.21.15.191:3300/0 conn(0x7f0e5c06bb90 0x7f0e5c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e53fff640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5affd640 1 -- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 msgr2=0x7f0e5c15ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5a7fc640 1 -- 172.21.15.155:0/1745941900 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437513301 0 0) 0x7f0e5c15bef0 con 0x7f0e5c0c99f0 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5affd640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c15ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5affd640 1 -- 172.21.15.155:0/1745941900 >> v1:172.21.15.155:6789/0 conn(0x7f0e5c0c99f0 legacy=0x7f0e5c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e5affd640 1 -- 172.21.15.155:0/1745941900 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c15bc10 con 0x7f0e5c06bb90 2024-04-25T13:17:12.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.659+0000 7f0e53fff640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c15ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:12.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.660+0000 7f0e5affd640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15af70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0097a0 tx=0x7f0e4c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=733bbc5260a465cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:12.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.660+0000 7f0e5a7fc640 1 -- 172.21.15.155:0/1745941900 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c037070 con 0x7f0e5c06bb90 2024-04-25T13:17:12.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.660+0000 7f0e5a7fc640 1 -- 172.21.15.155:0/1745941900 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c032440 con 0x7f0e5c06bb90 2024-04-25T13:17:12.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.660+0000 7f0e5a7fc640 1 -- 172.21.15.155:0/1745941900 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c032810 con 0x7f0e5c06bb90 2024-04-25T13:17:12.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.660+0000 7f0e618e8640 1 -- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c06bb90 msgr2=0x7f0e5c15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.660+0000 7f0e618e8640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15af70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0097a0 tx=0x7f0e4c02a210 comp rx=0 tx=0).stop 2024-04-25T13:17:12.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.661+0000 7f0e618e8640 1 -- 172.21.15.155:0/1745941900 shutdown_connections 2024-04-25T13:17:12.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.661+0000 7f0e618e8640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c15ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.661+0000 7f0e618e8640 1 --2- 172.21.15.155:0/1745941900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15af70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.661+0000 7f0e618e8640 1 -- 172.21.15.155:0/1745941900 >> 172.21.15.155:0/1745941900 conn(0x7f0e5c074d50 msgr2=0x7f0e5c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:12.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.661+0000 7f0e618e8640 1 -- 172.21.15.155:0/1745941900 shutdown_connections 2024-04-25T13:17:12.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.661+0000 7f0e618e8640 1 -- 172.21.15.155:0/1745941900 wait complete. 2024-04-25T13:17:12.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 Processor -- start 2024-04-25T13:17:12.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 -- start start 2024-04-25T13:17:12.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c0c99f0 0x7f0e5c1e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c074560 con 0x7f0e5c06bb90 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c15e8e0 con 0x7f0e5c0c99f0 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e618e8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c15f340 con 0x7f0e5c06bf70 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e5affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e5affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45674/0 (socket says 172.21.15.155:45674) 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.662+0000 7f0e5affd640 1 -- 172.21.15.155:0/2181377707 learned_addr learned my addr 172.21.15.155:0/2181377707 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e53fff640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5b7fe640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c0c99f0 0x7f0e5c1e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5affd640 1 -- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 msgr2=0x7f0e5c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5affd640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5affd640 1 -- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c0c99f0 msgr2=0x7f0e5c1e5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5affd640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c0c99f0 0x7f0e5c1e5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5affd640 1 -- 172.21.15.155:0/2181377707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c1f4b30 con 0x7f0e5c06bb90 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e5affd640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15b050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c035040 tx=0x7f0e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:12.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c037050 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c038040 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c1f0b30 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c004490 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.663+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c1f10f0 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.664+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c068e40 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.664+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e4c03c6d0 con 0x7f0e5c06bb90 2024-04-25T13:17:12.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.665+0000 7f0e58ff9640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0e3c06c8f0 0x7f0e3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:12.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.665+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0e4c0ac7b0 con 0x7f0e5c06bb90 2024-04-25T13:17:12.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.665+0000 7f0e53fff640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0e3c06c8f0 0x7f0e3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:12.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.665+0000 7f0e53fff640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0e3c06c8f0 0x7f0e3c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c1e7e40 tx=0x7f0e44009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:12.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.669+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e4c07a190 con 0x7f0e5c06bb90 2024-04-25T13:17:12.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.882+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e5c1538d0 con 0x7f0e5c06bb90 2024-04-25T13:17:12.882 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.882+0000 7f0e58ff9640 1 -- 172.21.15.155:0/2181377707 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6926 (secure 0 0 0) 0x7f0e4c07e490 con 0x7f0e5c06bb90 2024-04-25T13:17:12.883 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:12.883 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:17:11.835312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4305,"mds_1":4297,"mds_2":4284,"mds_3":4282,"mds_4":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":16,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"c","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4278,4282,4284,4297,4305]},"id":1}]} 2024-04-25T13:17:12.883 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.884+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0e3c06c8f0 msgr2=0x7f0e3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.884+0000 7f0e618e8640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0e3c06c8f0 0x7f0e3c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c1e7e40 tx=0x7f0e44009190 comp rx=0 tx=0).stop 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.884+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 msgr2=0x7f0e5c15b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.884+0000 7f0e618e8640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15b050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c035040 tx=0x7f0e4c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 shutdown_connections 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0e5c0c99f0 0x7f0e5c1e5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0e3c06c8f0 0x7f0e3c06edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0e5c06bf70 0x7f0e5c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 --2- 172.21.15.155:0/2181377707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e5c06bb90 0x7f0e5c15b050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 >> 172.21.15.155:0/2181377707 conn(0x7f0e5c074d50 msgr2=0x7f0e5c151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 shutdown_connections 2024-04-25T13:17:12.885 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:12.885+0000 7f0e618e8640 1 -- 172.21.15.155:0/2181377707 wait complete. 2024-04-25T13:17:13.500 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:16:20.990091+0000', 'modified': '2024-04-25T13:17:11.835312+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4305, 'mds_1': 4297, 'mds_2': 4284, 'mds_3': 4282, 'mds_4': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.155:6835/2131538111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2131538111}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2131538111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4282': {'gid': 4282, 'name': 'c', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.155:6837/290614525', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 290614525}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 290614525}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'e', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.155:6839/3774335819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 3774335819}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 3774335819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6834/1291944552', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 1291944552}, {'type': 'v1', 'addr': '172.21.15.191:6834', 'nonce': 1291944552}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.191:6837/2351082662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6835', 'nonce': 2351082662}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 2351082662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4305, 'qdb_cluster': [4278, 4282, 4284, 4297, 4305]} 2024-04-25T13:17:13.500 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T13:17:13.500 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T13:17:13.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.603+0000 7f8aeac31640 1 Processor -- start 2024-04-25T13:17:13.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.603+0000 7f8aeac31640 1 -- start start 2024-04-25T13:17:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8aeac31640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae4159710 0x7f8ae40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8aeac31640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8ae40cadc0 0x7f8ae4163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.626 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8aeac31640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae41603e0 con 0x7f8ae4163580 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8aeac31640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae4162bb0 con 0x7f8ae40cadc0 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8aeac31640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae415f860 con 0x7f8ae4159710 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae91ce640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f8ae4163580 0x7f8ae40cc3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55448/0 (socket says 172.21.15.155:55448) 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae91ce640 1 -- 172.21.15.155:0/1081479994 learned_addr learned my addr 172.21.15.155:0/1081479994 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/1081479994 >> v2:172.21.15.191:3300/0 conn(0x7f8ae40cadc0 0x7f8ae4163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1081479994 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae4159710 0x7f8ae40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae37fe640 1 -- 172.21.15.155:0/1081479994 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801980688 0 0) 0x7f8ae41603e0 con 0x7f8ae4163580 2024-04-25T13:17:13.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae37fe640 1 -- 172.21.15.155:0/1081479994 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad4003520 con 0x7f8ae4163580 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae89cd640 1 -- 172.21.15.155:0/1081479994 >> v2:172.21.15.191:3300/0 conn(0x7f8ae40cadc0 msgr2=0x7f8ae4163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1081479994 >> v2:172.21.15.191:3300/0 conn(0x7f8ae40cadc0 0x7f8ae4163040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae89cd640 1 -- 172.21.15.155:0/1081479994 >> v1:172.21.15.155:6789/0 conn(0x7f8ae4163580 legacy=0x7f8ae40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.604+0000 7f8ae89cd640 1 -- 172.21.15.155:0/1081479994 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae415fb40 con 0x7f8ae4159710 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.605+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1081479994 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae4159710 0x7f8ae40ca880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4162d30 tx=0x7f8ad802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=160f60da3f0226f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.605+0000 7f8ae37fe640 1 -- 172.21.15.155:0/1081479994 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8037070 con 0x7f8ae4159710 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.605+0000 7f8ae37fe640 1 -- 172.21.15.155:0/1081479994 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad8032440 con 0x7f8ae4159710 2024-04-25T13:17:13.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.605+0000 7f8ae37fe640 1 -- 172.21.15.155:0/1081479994 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80327f0 con 0x7f8ae4159710 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 -- 172.21.15.155:0/1081479994 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae4159710 msgr2=0x7f8ae40ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1081479994 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae4159710 0x7f8ae40ca880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4162d30 tx=0x7f8ad802a210 comp rx=0 tx=0).stop 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 -- 172.21.15.155:0/1081479994 shutdown_connections 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1081479994 >> v2:172.21.15.191:3300/0 conn(0x7f8ae40cadc0 0x7f8ae4163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1081479994 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae4159710 0x7f8ae40ca880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 -- 172.21.15.155:0/1081479994 >> 172.21.15.155:0/1081479994 conn(0x7f8ae406d610 msgr2=0x7f8ae4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 -- 172.21.15.155:0/1081479994 shutdown_connections 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.606+0000 7f8aeac31640 1 -- 172.21.15.155:0/1081479994 wait complete. 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.607+0000 7f8aeac31640 1 Processor -- start 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.607+0000 7f8aeac31640 1 -- start start 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae40cadc0 0x7f8ae4155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 0x7f8ae4152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ae4163580 0x7f8ae4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4159af0 con 0x7f8ae4159710 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae4160100 con 0x7f8ae4163580 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae41f8890 con 0x7f8ae40cadc0 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 0x7f8ae4152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 0x7f8ae4152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45678/0 (socket says 172.21.15.155:45678) 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 -- 172.21.15.155:0/1102528203 learned_addr learned my addr 172.21.15.155:0/1102528203 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ae4163580 0x7f8ae4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae40cadc0 0x7f8ae4155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 -- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae40cadc0 msgr2=0x7f8ae4155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae40cadc0 0x7f8ae4155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 -- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ae4163580 msgr2=0x7f8ae4153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ae4163580 0x7f8ae4153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 -- 172.21.15.155:0/1102528203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae41f8af0 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 0x7f8ae4152b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000e9e0 tx=0x7f8ad000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae17fa640 1 -- 172.21.15.155:0/1102528203 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0017070 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae17fa640 1 -- 172.21.15.155:0/1102528203 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad000c9d0 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae4150330 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8ae17fa640 1 -- 172.21.15.155:0/1102528203 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000cdc0 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.608+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae41508f0 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.610+0000 7f8ae17fa640 1 -- 172.21.15.155:0/1102528203 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ad001a070 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.610+0000 7f8ae17fa640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8ac806c8f0 0x7f8ac806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.610+0000 7f8ae17fa640 1 -- 172.21.15.155:0/1102528203 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8ad008be10 con 0x7f8ae4159710 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.610+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8ac806c8f0 0x7f8ac806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.611+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8ac806c8f0 0x7f8ac806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8034000 tx=0x7f8ad802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.631 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.611+0000 7f8aeda27740 1 Processor -- start 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.611+0000 7f8aeda27740 1 -- start start 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa39fc0 0x55fcbfa3df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8aeda27740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fcbf9a3c50 con 0x55fcbfa3aa70 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fcbf940830 con 0x55fcbfa3a690 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fcbf99fc10 con 0x55fcbfa39fc0 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae89cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa888a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45690/0 (socket says 172.21.15.155:45690) 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae89cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:34038/0 (socket says 172.21.15.155:34038) 2024-04-25T13:17:13.632 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa39fc0 0x55fcbfa3df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 -- 172.21.15.155:0/4279305271 learned_addr learned my addr 172.21.15.155:0/4279305271 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 -- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa39fc0 msgr2=0x55fcbfa3df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa39fc0 0x55fcbfa3df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 -- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 msgr2=0x55fcbfa7ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 -- 172.21.15.155:0/4279305271 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcbf6b62d0 con 0x55fcbfa3aa70 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.612+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa888a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8adc002020 tx=0x7f8adc007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898266e1fa59bbec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8ace7fc640 1 -- 172.21.15.155:0/4279305271 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc012560 con 0x55fcbfa3aa70 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8ace7fc640 1 -- 172.21.15.155:0/4279305271 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8adc018070 con 0x55fcbfa3aa70 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8ace7fc640 1 -- 172.21.15.155:0/4279305271 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc012900 con 0x55fcbfa3aa70 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 -- 172.21.15.155:0/4279305271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 msgr2=0x55fcbfa888a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa888a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8adc002020 tx=0x7f8adc007410 comp rx=0 tx=0).stop 2024-04-25T13:17:13.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 -- 172.21.15.155:0/4279305271 shutdown_connections 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa888a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa39fc0 0x55fcbfa3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 --2- 172.21.15.155:0/4279305271 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 -- 172.21.15.155:0/4279305271 >> 172.21.15.155:0/4279305271 conn(0x55fcbfa3bc80 msgr2=0x55fcbfa3e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 -- 172.21.15.155:0/4279305271 shutdown_connections 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.613+0000 7f8aeda27740 1 -- 172.21.15.155:0/4279305271 wait complete. 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.614+0000 7f8aeda27740 1 -- start start 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.614+0000 7f8aeda27740 1 Processor -- start 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfa65ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfa7f700 con 0x55fcbfa678c0 2024-04-25T13:17:13.634 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fcbf93e470 con 0x55fcbfa3a690 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fcbfa3d0e0 con 0x55fcbfa3aa70 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 10 client.0 _ll_register_callbacks cb 0x55fcbf963f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45706/0 (socket says 172.21.15.155:45706) 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 -- 172.21.15.155:0/1665634978 learned_addr learned my addr 172.21.15.155:0/1665634978 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfa65ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 -- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 msgr2=0x55fcbfa65ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfa65ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 -- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 msgr2=0x55fcbfa7fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 -- 172.21.15.155:0/1665634978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcbf7806b0 con 0x55fcbfa678c0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5e870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8adc001580 tx=0x7f8adc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5545f85f78a93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ac37fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:13.635 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ac37fe640 1 -- 172.21.15.155:0/1665634978 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc012d20 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8ac37fe640 1 -- 172.21.15.155:0/1665634978 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8adc01c450 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.615+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8adc018070 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8ac37fe640 1 -- 172.21.15.155:0/1665634978 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8adc02e050 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 10 client.4827 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55fcbfa60040 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8ac37fe640 1 -- 172.21.15.155:0/1665634978 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8adc018070 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8ac37fe640 1 -- 172.21.15.155:0/1665634978 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8adc031020 con 0x55fcbfa678c0 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 10 client.4827 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 10 client.4827 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 20 client.4827 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa5ef30 0x55fcbfa93980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 4 client.4827 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 --> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcbf9b1670 con 0x55fcbfa5ef30 2024-04-25T13:17:13.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa5ef30 0x55fcbfa93980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:13.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8ac37fe640 10 client.4827 ms_handle_connect on v2:172.21.15.155:6834/2131538111 2024-04-25T13:17:13.637 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:13.616+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa5ef30 0x55fcbfa93980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a9618389dc99f68 server_cookie=22162acfb25134be in_seq=0 out_seq=0 2024-04-25T13:17:16.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.840+0000 7f8ac37fe640 1 -- 172.21.15.155:0/1665634978 <== mds.4 v2:172.21.15.155:6834/2131538111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fcbf9b1670 con 0x55fcbfa5ef30 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.840+0000 7f8ac37fe640 10 client.4827 handle_command_reply: tid=0 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 client.4827 shutdown 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 msgr2=0x55fcbfa5e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5e870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8adc001580 tx=0x7f8adc001250 comp rx=0 tx=0).stop 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 shutdown_connections 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa5ef30 0x55fcbfa93980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5e870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfa65ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8ac37fe640 0 client.4827 ms_handle_reset on v2:172.21.15.155:6834/2131538111 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 --2- 172.21.15.155:0/1665634978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa7fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 >> 172.21.15.155:0/1665634978 conn(0x55fcbfa39fc0 msgr2=0x55fcbfa7da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 shutdown_connections 2024-04-25T13:17:16.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 1 -- 172.21.15.155:0/1665634978 wait complete. 2024-04-25T13:17:16.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.841+0000 7f8aeda27740 20 client.4827 trim_cache size 0 max 16384 2024-04-25T13:17:16.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 Processor -- start 2024-04-25T13:17:16.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 -- start start 2024-04-25T13:17:16.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 0x55fcbfa66fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa79640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa678c0 0x55fcbfa79b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae41f5f10 con 0x55fcbfa3a690 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfa80880 con 0x55fcbfa3aa70 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.861+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fcbfa5edb0 con 0x55fcbfa678c0 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 0x55fcbfa66fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 0x55fcbfa66fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45722/0 (socket says 172.21.15.155:45722) 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 -- 172.21.15.155:0/3553986355 learned_addr learned my addr 172.21.15.155:0/3553986355 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa678c0 0x55fcbfa79b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa79640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 -- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa678c0 msgr2=0x55fcbfa79b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa678c0 0x55fcbfa79b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 -- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3aa70 msgr2=0x55fcbfa79640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa79640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 -- 172.21.15.155:0/3553986355 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcbfa7f5a0 con 0x55fcbfa3a690 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa678c0 0x55fcbfa79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa79640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 0x55fcbfa66fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ad802a800 tx=0x7f8ad802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee8aea8e0a44f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.862+0000 7f8acdffb640 1 -- 172.21.15.155:0/3553986355 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8037040 con 0x55fcbfa3a690 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8acdffb640 1 -- 172.21.15.155:0/3553986355 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad803d440 con 0x55fcbfa3a690 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8acdffb640 1 -- 172.21.15.155:0/3553986355 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad803d7f0 con 0x55fcbfa3a690 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 -- 172.21.15.155:0/3553986355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 msgr2=0x55fcbfa66fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 0x55fcbfa66fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ad802a800 tx=0x7f8ad802c000 comp rx=0 tx=0).stop 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 -- 172.21.15.155:0/3553986355 shutdown_connections 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa678c0 0x55fcbfa79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3aa70 0x55fcbfa79640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 --2- 172.21.15.155:0/3553986355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa3a690 0x55fcbfa66fb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.865 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 -- 172.21.15.155:0/3553986355 >> 172.21.15.155:0/3553986355 conn(0x55fcbfa39fc0 msgr2=0x55fcbfa5f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 -- 172.21.15.155:0/3553986355 shutdown_connections 2024-04-25T13:17:16.866 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.863+0000 7f8aeda27740 1 -- 172.21.15.155:0/3553986355 wait complete. 2024-04-25T13:17:16.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.864+0000 7f8aeda27740 1 -- start start 2024-04-25T13:17:16.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.864+0000 7f8aeda27740 1 Processor -- start 2024-04-25T13:17:16.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa8d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfafd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfa93800 con 0x55fcbfa678c0 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfa5f3d0 con 0x55fcbfa3a690 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55fcbfa93ed0 con 0x55fcbfa3aa70 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8aeda27740 10 client.0 _ll_register_callbacks cb 0x7f8ad40036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8ae91ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8ae91ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45736/0 (socket says 172.21.15.155:45736) 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8ae91ce640 1 -- 172.21.15.155:0/671936482 learned_addr learned my addr 172.21.15.155:0/671936482 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8ae3fff640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfafd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.865+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa8d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ae91ce640 1 -- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 msgr2=0x55fcbfafd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfafd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ae91ce640 1 -- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 msgr2=0x55fcbfa8d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa8d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ae91ce640 1 -- 172.21.15.155:0/671936482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcbfa7de90 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ae91ce640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5ca10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55fcbfa649a0 tx=0x7f8adc00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4419cd456380f165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ac37fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ac37fe640 1 -- 172.21.15.155:0/671936482 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8adc03b420 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ac37fe640 1 -- 172.21.15.155:0/671936482 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8adc03b5c0 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad803d440 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ac37fe640 1 -- 172.21.15.155:0/671936482 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f8adc043050 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8aeda27740 10 client.4833 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55fcbfaa48a0 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.866+0000 7f8ac37fe640 1 -- 172.21.15.155:0/671936482 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad803d440 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8ac37fe640 1 -- 172.21.15.155:0/671936482 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f8adc046020 con 0x55fcbfa678c0 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8aeda27740 10 client.4833 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:16.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8aeda27740 10 client.4833 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8aeda27740 20 client.4833 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8aeda27740 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa836c0 0x55fcbfa83aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8aeda27740 4 client.4833 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 --> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] -- command(tid 0: {"prefix": "status"}) -- 0x55fcbf9ab4e0 con 0x55fcbfa836c0 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa836c0 0x55fcbfa83aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8ae89cd640 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa836c0 0x55fcbfa83aa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4b04a4968f91ea8d server_cookie=cd00d42aaed2768e in_seq=0 out_seq=0 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8ac37fe640 10 client.4833 ms_handle_connect on v2:172.21.15.155:6834/2131538111 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8ac37fe640 1 -- 172.21.15.155:0/671936482 <== mds.4 v2:172.21.15.155:6834/2131538111 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55fcbf9ab4e0 con 0x55fcbfa836c0 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.867+0000 7f8ac37fe640 10 client.4833 handle_command_reply: tid=0 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 client.4833 shutdown 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 msgr2=0x55fcbfa5ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5ca10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55fcbfa649a0 tx=0x7f8adc00a000 comp rx=0 tx=0).stop 2024-04-25T13:17:16.873 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 shutdown_connections 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:6834/2131538111,v1:172.21.15.155:6835/2131538111] conn(0x55fcbfa836c0 0x55fcbfa83aa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fcbfa678c0 0x55fcbfa5ca10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55fcbfa3aa70 0x55fcbfafd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8ac37fe640 0 client.4833 ms_handle_reset on v2:172.21.15.155:6834/2131538111 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 --2- 172.21.15.155:0/671936482 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55fcbfa3a690 0x55fcbfa8d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 >> 172.21.15.155:0/671936482 conn(0x55fcbfa39fc0 msgr2=0x55fcbfa80a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 shutdown_connections 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 1 -- 172.21.15.155:0/671936482 wait complete. 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.868+0000 7f8aeda27740 20 client.4833 trim_cache size 0 max 16384 2024-04-25T13:17:16.874 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "99137c81-994c-40b7-8b7f-aeb03a97ab57", 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 4, 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4278, 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 11.043373166, 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 61.748577197000003 2024-04-25T13:17:16.875 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:16.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8ac806c8f0 msgr2=0x7f8ac806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8ac806c8f0 0x7f8ac806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8034000 tx=0x7f8ad802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:16.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 msgr2=0x7f8ae4152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 0x7f8ae4152b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8ad000e9e0 tx=0x7f8ad000eea0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 shutdown_connections 2024-04-25T13:17:16.876 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ae4163580 0x7f8ae4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ae4159710 0x7f8ae4152b50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8ac806c8f0 0x7f8ac806edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 --2- 172.21.15.155:0/1102528203 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ae40cadc0 0x7f8ae4155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 >> 172.21.15.155:0/1102528203 conn(0x7f8ae406d610 msgr2=0x7f8ae4157810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 shutdown_connections 2024-04-25T13:17:16.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.869+0000 7f8aeac31640 1 -- 172.21.15.155:0/1102528203 wait complete. 2024-04-25T13:17:16.882 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T13:17:16.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.986+0000 7fa0c6a8a640 1 Processor -- start 2024-04-25T13:17:16.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.986+0000 7fa0c6a8a640 1 -- start start 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c6a8a640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa0c0155380 0x7fa0c00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c6a8a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c00c92f0 0x7fa0c00c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c6a8a640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c015b5a0 con 0x7fa0c015b0f0 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c6a8a640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c006fab0 con 0x7fa0c0155380 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c6a8a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c015b880 con 0x7fa0c00c92f0 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c4826640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa0c0155380 0x7fa0c00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c5027640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c00c92f0 0x7fa0c00c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0bffff640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7fa0c015b0f0 0x7fa0c006ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:58158/0 (socket says 172.21.15.155:58158) 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0bffff640 1 -- 172.21.15.155:0/3557520982 learned_addr learned my addr 172.21.15.155:0/3557520982 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c5027640 1 -- 172.21.15.155:0/3557520982 >> v2:172.21.15.191:3300/0 conn(0x7fa0c0155380 msgr2=0x7fa0c00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:16.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c5027640 1 --2- 172.21.15.155:0/3557520982 >> v2:172.21.15.191:3300/0 conn(0x7fa0c0155380 0x7fa0c00c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c5027640 1 -- 172.21.15.155:0/3557520982 >> v1:172.21.15.191:6789/0 conn(0x7fa0c015b0f0 legacy=0x7fa0c006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c5027640 1 -- 172.21.15.155:0/3557520982 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c015bb60 con 0x7fa0c00c92f0 2024-04-25T13:17:16.989 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.987+0000 7fa0c4826640 1 --2- 172.21.15.155:0/3557520982 >> v2:172.21.15.191:3300/0 conn(0x7fa0c0155380 0x7fa0c00c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:16.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.988+0000 7fa0c5027640 1 --2- 172.21.15.155:0/3557520982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c00c92f0 0x7fa0c00c9730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009d90 tx=0x7fa0b802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f8ff30008f74abd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.988+0000 7fa0bf7fe640 1 -- 172.21.15.155:0/3557520982 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031600 con 0x7fa0c00c92f0 2024-04-25T13:17:16.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.988+0000 7fa0bf7fe640 1 -- 172.21.15.155:0/3557520982 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b80317a0 con 0x7fa0c00c92f0 2024-04-25T13:17:16.990 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.988+0000 7fa0bf7fe640 1 -- 172.21.15.155:0/3557520982 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031b70 con 0x7fa0c00c92f0 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/3557520982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c00c92f0 msgr2=0x7fa0c00c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/3557520982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c00c92f0 0x7fa0c00c9730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009d90 tx=0x7fa0b802a5d0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/3557520982 shutdown_connections 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/3557520982 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c00c92f0 0x7fa0c00c9730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/3557520982 >> v2:172.21.15.191:3300/0 conn(0x7fa0c0155380 0x7fa0c00c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/3557520982 >> 172.21.15.155:0/3557520982 conn(0x7fa0c00ca0d0 msgr2=0x7fa0c00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/3557520982 shutdown_connections 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.989+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/3557520982 wait complete. 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.990+0000 7fa0c6a8a640 1 Processor -- start 2024-04-25T13:17:16.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.990+0000 7fa0c6a8a640 1 -- start start 2024-04-25T13:17:16.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c6a8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 0x7fa0c0072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c6a8a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0c0155380 0x7fa0c00c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c6a8a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c015b0f0 0x7fa0c00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:16.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c6a8a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c00c8510 con 0x7fa0c00c92f0 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c6a8a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0155760 con 0x7fa0c0155380 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c6a8a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c00c8690 con 0x7fa0c015b0f0 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 0x7fa0c0072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c5027640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c015b0f0 0x7fa0c00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0c0155380 0x7fa0c00c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 0x7fa0c0072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45752/0 (socket says 172.21.15.155:45752) 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c4826640 1 -- 172.21.15.155:0/1567697103 learned_addr learned my addr 172.21.15.155:0/1567697103 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c5027640 1 -- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0c0155380 msgr2=0x7fa0c00c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c5027640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0c0155380 0x7fa0c00c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c5027640 1 -- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 msgr2=0x7fa0c0072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c5027640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 0x7fa0c0072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:16.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c5027640 1 -- 172.21.15.155:0/1567697103 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c01f0e00 con 0x7fa0c015b0f0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0c4826640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 0x7fa0c0072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.991+0000 7fa0bffff640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0c0155380 0x7fa0c00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.992+0000 7fa0c5027640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c015b0f0 0x7fa0c00c6070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0071ba0 tx=0x7fa0b8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.992+0000 7fa0bd7fa640 1 -- 172.21.15.155:0/1567697103 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8040070 con 0x7fa0c015b0f0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.992+0000 7fa0bd7fa640 1 -- 172.21.15.155:0/1567697103 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b8030ba0 con 0x7fa0c015b0f0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.992+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c01f10a0 con 0x7fa0c015b0f0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.992+0000 7fa0bd7fa640 1 -- 172.21.15.155:0/1567697103 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8009450 con 0x7fa0c015b0f0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.992+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c01f1660 con 0x7fa0c015b0f0 2024-04-25T13:17:16.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.994+0000 7fa0bd7fa640 1 -- 172.21.15.155:0/1567697103 <== mon.2 v2:172.21.15.191:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0b8039040 con 0x7fa0c015b0f0 2024-04-25T13:17:17.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.994+0000 7fa0bd7fa640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0ac06c8f0 0x7fa0ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.994+0000 7fa0bd7fa640 1 -- 172.21.15.155:0/1567697103 <== mon.2 v2:172.21.15.191:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa0b80ad3d0 con 0x7fa0c015b0f0 2024-04-25T13:17:17.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.994+0000 7fa0c4826640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0ac06c8f0 0x7fa0ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.994+0000 7fa0c4826640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0ac06c8f0 0x7fa0ac06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009560 tx=0x7fa0b0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 Processor -- start 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 -- start start 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b82a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 0x55d352b41f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d352aa7c50 con 0x55d352b3dfc0 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d352a44830 con 0x55d352b3ea70 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.995+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55d352aa3c10 con 0x55d352b3e690 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 0x55d352b41f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 0x55d352b41f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45764/0 (socket says 172.21.15.155:45764) 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b82a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 -- 172.21.15.155:0/3933691481 learned_addr learned my addr 172.21.15.155:0/3933691481 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.003 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0c5027640 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 -- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 msgr2=0x55d352b82a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b82a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 -- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 msgr2=0x55d352b8c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b8c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 -- 172.21.15.155:0/3933691481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3527ba2d0 con 0x55d352b3dfc0 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0bffff640 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 0x55d352b41f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4004ef0 tx=0x7fa0b4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d629b122bdb58949 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0a67fc640 1 -- 172.21.15.155:0/3933691481 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4019070 con 0x55d352b3dfc0 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0a67fc640 1 -- 172.21.15.155:0/3933691481 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4001b50 con 0x55d352b3dfc0 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.996+0000 7fa0a67fc640 1 -- 172.21.15.155:0/3933691481 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4014650 con 0x55d352b3dfc0 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3933691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 msgr2=0x55d352b41f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 0x55d352b41f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4004ef0 tx=0x7fa0b4007430 comp rx=0 tx=0).stop 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3933691481 shutdown_connections 2024-04-25T13:17:17.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b8c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3dfc0 0x55d352b41f40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3933691481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b82a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3933691481 >> 172.21.15.155:0/3933691481 conn(0x55d352b3fc80 msgr2=0x55d352b42580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3933691481 shutdown_connections 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3933691481 wait complete. 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 -- start start 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.997+0000 7fa0c97a2740 1 Processor -- start 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b65ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 0x55d352b94240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d352b83700 con 0x55d352b6c6e0 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d352a42470 con 0x55d352b3ea70 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55d352b410e0 con 0x55d352b3e690 2024-04-25T13:17:17.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c97a2740 10 client.0 _ll_register_callbacks cb 0x55d352a67f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c5027640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 0x55d352b94240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b65ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c5027640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 0x55d352b94240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45776/0 (socket says 172.21.15.155:45776) 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b65ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:33154/0 (socket says 172.21.15.155:33154) 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.998+0000 7fa0c5027640 1 -- 172.21.15.155:0/3543447800 learned_addr learned my addr 172.21.15.155:0/3543447800 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c5027640 1 -- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 msgr2=0x55d352b65ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c5027640 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b65ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c5027640 1 -- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 msgr2=0x55d352b981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c5027640 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c5027640 1 -- 172.21.15.155:0/3543447800 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3528846b0 con 0x55d352b6c6e0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c4826640 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b65ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c5027640 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 0x55d352b94240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8031fd0 tx=0x7fa0b807aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95766cdbcdf27073 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa09f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa09f7fe640 1 -- 172.21.15.155:0/3543447800 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80a9060 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa09f7fe640 1 -- 172.21.15.155:0/3543447800 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa0b8077540 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b4001b50 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa09f7fe640 1 -- 172.21.15.155:0/3543447800 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa0b8088050 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 10 client.4842 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d352b63150 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa09f7fe640 1 -- 172.21.15.155:0/3543447800 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4001b50 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa09f7fe640 1 -- 172.21.15.155:0/3543447800 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fa0b804d030 con 0x55d352b6c6e0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 10 client.4842 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 10 client.4842 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 20 client.4842 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352ba11d0 0x55d352ba35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 4 client.4842 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 --> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d352ab5670 con 0x55d352ba11d0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:16.999+0000 7fa0c4826640 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352ba11d0 0x55d352ba35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.000+0000 7fa09f7fe640 10 client.4842 ms_handle_connect on v2:172.21.15.155:6836/290614525 2024-04-25T13:17:17.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.000+0000 7fa0c4826640 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352ba11d0 0x55d352ba35c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cd140fd78beb3da4 server_cookie=59a3112b5aed9b9e in_seq=0 out_seq=0 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.000+0000 7fa09f7fe640 1 -- 172.21.15.155:0/3543447800 <== mds.3 v2:172.21.15.155:6836/290614525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d352ab5670 con 0x55d352ba11d0 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.000+0000 7fa09f7fe640 10 client.4842 handle_command_reply: tid=0 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.000+0000 7fa0c97a2740 1 client.4842 shutdown 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 msgr2=0x55d352b94240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 0x55d352b94240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8031fd0 tx=0x7fa0b807aed0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 shutdown_connections 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352ba11d0 0x55d352ba35c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b6c6e0 0x55d352b94240 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352b981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa09f7fe640 0 client.4842 ms_handle_reset on v2:172.21.15.155:6836/290614525 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/3543447800 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b3e690 0x55d352b65ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 >> 172.21.15.155:0/3543447800 conn(0x55d352b3dfc0 msgr2=0x55d352b3d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 shutdown_connections 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 1 -- 172.21.15.155:0/3543447800 wait complete. 2024-04-25T13:17:17.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.001+0000 7fa0c97a2740 20 client.4842 trim_cache size 0 max 16384 2024-04-25T13:17:17.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 Processor -- start 2024-04-25T13:17:17.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 -- start start 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3e690 0x55d352b38e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 0x55d352b393b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352b69ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01feff0 con 0x55d352b3ea70 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01fd230 con 0x55d352b3e690 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55d352b83700 con 0x55d352b6c6e0 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 0x55d352b393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 0x55d352b393b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45786/0 (socket says 172.21.15.155:45786) 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.019+0000 7fa0bffff640 1 -- 172.21.15.155:0/619813434 learned_addr learned my addr 172.21.15.155:0/619813434 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0c4826640 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3e690 0x55d352b38e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0bffff640 1 -- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 msgr2=0x55d352b69ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0c5027640 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352b69ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0bffff640 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352b69ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0bffff640 1 -- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3e690 msgr2=0x55d352b38e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0bffff640 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3e690 0x55d352b38e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0bffff640 1 -- 172.21.15.155:0/619813434 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d352b44330 con 0x55d352b3ea70 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0c4826640 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3e690 0x55d352b38e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0bffff640 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 0x55d352b393b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4013000 tx=0x7fa0b400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee29ab2e2adc5db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0a5ffb640 1 -- 172.21.15.155:0/619813434 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4025070 con 0x55d352b3ea70 2024-04-25T13:17:17.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0a5ffb640 1 -- 172.21.15.155:0/619813434 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4004900 con 0x55d352b3ea70 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0a5ffb640 1 -- 172.21.15.155:0/619813434 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4019040 con 0x55d352b3ea70 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0c97a2740 1 -- 172.21.15.155:0/619813434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 msgr2=0x55d352b393b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.020+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 0x55d352b393b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4013000 tx=0x7fa0b400c000 comp rx=0 tx=0).stop 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 -- 172.21.15.155:0/619813434 shutdown_connections 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352b69ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3ea70 0x55d352b393b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/619813434 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3e690 0x55d352b38e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 -- 172.21.15.155:0/619813434 >> 172.21.15.155:0/619813434 conn(0x55d352b3dfc0 msgr2=0x55d352b658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 -- 172.21.15.155:0/619813434 shutdown_connections 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 -- 172.21.15.155:0/619813434 wait complete. 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 -- start start 2024-04-25T13:17:17.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.021+0000 7fa0c97a2740 1 Processor -- start 2024-04-25T13:17:17.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 0x55d352b910c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352bfe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352bf7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d352b947d0 con 0x55d352b3e690 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55d352b62cc0 con 0x55d352b3ea70 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55d352b5f440 con 0x55d352b6c6e0 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c97a2740 10 client.0 _ll_register_callbacks cb 0x7fa0b8007060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 0x55d352b910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 0x55d352b910c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45788/0 (socket says 172.21.15.155:45788) 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 -- 172.21.15.155:0/1450648343 learned_addr learned my addr 172.21.15.155:0/1450648343 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c5027640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352bf7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0bffff640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352bfe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 -- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 msgr2=0x55d352bf7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352bf7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 -- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 msgr2=0x55d352bfe450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352bfe450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.022+0000 7fa0c4826640 1 -- 172.21.15.155:0/1450648343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d352bfe990 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c4826640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 0x55d352b910c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0016040 tx=0x7fa0b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374088327e59f212 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa09f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa09f7fe640 1 -- 172.21.15.155:0/1450648343 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b002f070 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa09f7fe640 1 -- 172.21.15.155:0/1450648343 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa0b002b350 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0b4004900 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa09f7fe640 1 -- 172.21.15.155:0/1450648343 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa0b003a050 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 10 client.4848 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55d352b8dd10 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa09f7fe640 1 -- 172.21.15.155:0/1450648343 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4004900 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa09f7fe640 1 -- 172.21.15.155:0/1450648343 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fa0b003d020 con 0x55d352b3e690 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 10 client.4848 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 10 client.4848 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 20 client.4848 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352c02270 0x55d352c0aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 4 client.4848 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 --> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] -- command(tid 0: {"prefix": "status"}) -- 0x55d352aaf4e0 con 0x55d352c02270 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.023+0000 7fa0bffff640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352c02270 0x55d352c0aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa09f7fe640 10 client.4848 ms_handle_connect on v2:172.21.15.155:6836/290614525 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0bffff640 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352c02270 0x55d352c0aae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=89e711299a958b7e server_cookie=66058e9ed5980635 in_seq=0 out_seq=0 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa09f7fe640 1 -- 172.21.15.155:0/1450648343 <== mds.3 v2:172.21.15.155:6836/290614525 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d352aaf4e0 con 0x55d352c02270 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa09f7fe640 10 client.4848 handle_command_reply: tid=0 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 client.4848 shutdown 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 msgr2=0x55d352b910c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 0x55d352b910c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0016040 tx=0x7fa0b0004730 comp rx=0 tx=0).stop 2024-04-25T13:17:17.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 shutdown_connections 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:6836/290614525,v1:172.21.15.155:6837/290614525] conn(0x55d352c02270 0x55d352c0aae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55d352b6c6e0 0x55d352bf7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d352b3ea70 0x55d352bfe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 --2- 172.21.15.155:0/1450648343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d352b3e690 0x55d352b910c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa09f7fe640 0 client.4848 ms_handle_reset on v2:172.21.15.155:6836/290614525 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 >> 172.21.15.155:0/1450648343 conn(0x55d352b3dfc0 msgr2=0x55d352b43570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 shutdown_connections 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 1 -- 172.21.15.155:0/1450648343 wait complete. 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.024+0000 7fa0c97a2740 20 client.4848 trim_cache size 0 max 16384 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "99137c81-994c-40b7-8b7f-aeb03a97ab57", 2024-04-25T13:17:17.031 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 3, 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4282, 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 17.222921431, 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 61.903228204000001 2024-04-25T13:17:17.032 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0ac06c8f0 msgr2=0x7fa0ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0ac06c8f0 0x7fa0ac06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009560 tx=0x7fa0b0009190 comp rx=0 tx=0).stop 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c015b0f0 msgr2=0x7fa0c00c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c015b0f0 0x7fa0c00c6070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0071ba0 tx=0x7fa0b8004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 shutdown_connections 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0ac06c8f0 0x7fa0ac06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0c015b0f0 0x7fa0c00c6070 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0c0155380 0x7fa0c00c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 --2- 172.21.15.155:0/1567697103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c00c92f0 0x7fa0c0072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 >> 172.21.15.155:0/1567697103 conn(0x7fa0c00ca0d0 msgr2=0x7fa0c00c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 shutdown_connections 2024-04-25T13:17:17.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.025+0000 7fa0c6a8a640 1 -- 172.21.15.155:0/1567697103 wait complete. 2024-04-25T13:17:17.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T13:17:17.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.133+0000 7fc695fb4640 1 Processor -- start 2024-04-25T13:17:17.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.133+0000 7fc695fb4640 1 -- start start 2024-04-25T13:17:17.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc695fb4640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc6900ca6e0 0x7fc690152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc695fb4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6900caac0 0x7fc6901530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc695fb4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900708b0 0x7fc6901595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.135 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc695fb4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900c5600 con 0x7fc6900caac0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc695fb4640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900c6bf0 con 0x7fc6900ca6e0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc695fb4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc6900c6e60 con 0x7fc6900708b0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc68effd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6900caac0 0x7fc6901530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc68effd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6900caac0 0x7fc6901530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45800/0 (socket says 172.21.15.155:45800) 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc68effd640 1 -- 172.21.15.155:0/2623165332 learned_addr learned my addr 172.21.15.155:0/2623165332 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2623165332 >> v2:172.21.15.191:3300/0 conn(0x7fc6900ca6e0 0x7fc690152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.134+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900708b0 0x7fc6901595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68effd640 1 -- 172.21.15.155:0/2623165332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900708b0 msgr2=0x7fc6901595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68effd640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900708b0 0x7fc6901595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68effd640 1 -- 172.21.15.155:0/2623165332 >> v2:172.21.15.191:3300/0 conn(0x7fc6900ca6e0 msgr2=0x7fc690152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68effd640 1 --2- 172.21.15.155:0/2623165332 >> v2:172.21.15.191:3300/0 conn(0x7fc6900ca6e0 0x7fc690152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68effd640 1 -- 172.21.15.155:0/2623165332 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6900c7140 con 0x7fc6900caac0 2024-04-25T13:17:17.136 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2623165332 >> v2:172.21.15.191:3300/0 conn(0x7fc6900ca6e0 0x7fc690152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:17.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900708b0 0x7fc6901595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:17.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68effd640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900caac0 0x7fc6901530f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc690075db0 tx=0x7fc68402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e852e443965dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68e7fc640 1 -- 172.21.15.155:0/2623165332 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684037070 con 0x7fc6900caac0 2024-04-25T13:17:17.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68e7fc640 1 -- 172.21.15.155:0/2623165332 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc684032440 con 0x7fc6900caac0 2024-04-25T13:17:17.137 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.135+0000 7fc68e7fc640 1 -- 172.21.15.155:0/2623165332 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684032810 con 0x7fc6900caac0 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 -- 172.21.15.155:0/2623165332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900caac0 msgr2=0x7fc6901530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900caac0 0x7fc6901530f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc690075db0 tx=0x7fc68402a210 comp rx=0 tx=0).stop 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 -- 172.21.15.155:0/2623165332 shutdown_connections 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900708b0 0x7fc6901595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 --2- 172.21.15.155:0/2623165332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900caac0 0x7fc6901530f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 --2- 172.21.15.155:0/2623165332 >> v2:172.21.15.191:3300/0 conn(0x7fc6900ca6e0 0x7fc690152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 -- 172.21.15.155:0/2623165332 >> 172.21.15.155:0/2623165332 conn(0x7fc69006bd10 msgr2=0x7fc69006c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 -- 172.21.15.155:0/2623165332 shutdown_connections 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.136+0000 7fc695fb4640 1 -- 172.21.15.155:0/2623165332 wait complete. 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.137+0000 7fc695fb4640 1 Processor -- start 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.137+0000 7fc695fb4640 1 -- start start 2024-04-25T13:17:17.140 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc695fb4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6900708b0 0x7fc6901f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc695fb4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 0x7fc690151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc695fb4640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900caac0 0x7fc6900cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc695fb4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900c79e0 con 0x7fc6900ca6e0 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc695fb4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc6900c7700 con 0x7fc6900708b0 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc695fb4640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc6901590b0 con 0x7fc6900caac0 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 0x7fc690151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 0x7fc690151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45802/0 (socket says 172.21.15.155:45802) 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 -- 172.21.15.155:0/3269804717 learned_addr learned my addr 172.21.15.155:0/3269804717 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6900708b0 0x7fc6901f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68ffff640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900caac0 0x7fc6900cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 -- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900caac0 msgr2=0x7fc6900cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900caac0 0x7fc6900cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 -- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6900708b0 msgr2=0x7fc6901f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.141 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6900708b0 0x7fc6901f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68effd640 1 -- 172.21.15.155:0/3269804717 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901f4f40 con 0x7fc6900ca6e0 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68ffff640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900caac0 0x7fc6900cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.138+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6900708b0 0x7fc6901f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.139+0000 7fc68effd640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 0x7fc690151fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc68402a250 tx=0x7fc6840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.139+0000 7fc677fff640 1 -- 172.21.15.155:0/3269804717 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684041020 con 0x7fc6900ca6e0 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.139+0000 7fc677fff640 1 -- 172.21.15.155:0/3269804717 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6840306c0 con 0x7fc6900ca6e0 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.139+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc690148390 con 0x7fc6900ca6e0 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.139+0000 7fc677fff640 1 -- 172.21.15.155:0/3269804717 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684037040 con 0x7fc6900ca6e0 2024-04-25T13:17:17.142 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.139+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69014e550 con 0x7fc6900ca6e0 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.140+0000 7fc677fff640 1 -- 172.21.15.155:0/3269804717 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc684044020 con 0x7fc6900ca6e0 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.141+0000 7fc677fff640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c920 0x7fc67c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.141+0000 7fc677fff640 1 -- 172.21.15.155:0/3269804717 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc6840ac470 con 0x7fc6900ca6e0 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.141+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c920 0x7fc67c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.141+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c920 0x7fc67c06ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc680006fd0 tx=0x7fc680008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.141+0000 7fc698da9740 1 Processor -- start 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.141+0000 7fc698da9740 1 -- start start 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862690 0x5632188a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218861fc0 0x563218865f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc698da9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc698da9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5632187cbc50 con 0x563218862a70 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563218768830 con 0x563218861fc0 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x5632187c7c10 con 0x563218862690 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc68ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc68ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45814/0 (socket says 172.21.15.155:45814) 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc68ffff640 1 -- 172.21.15.155:0/2403113448 learned_addr learned my addr 172.21.15.155:0/2403113448 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862690 0x5632188a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.142+0000 7fc68effd640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218861fc0 0x563218865f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68ffff640 1 -- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862690 msgr2=0x5632188a6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862690 0x5632188a6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68ffff640 1 -- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218861fc0 msgr2=0x563218865f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218861fc0 0x563218865f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68ffff640 1 -- 172.21.15.155:0/2403113448 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632184de2d0 con 0x563218862a70 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862690 0x5632188a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68effd640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218861fc0 0x563218865f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188b08a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc688007410 tx=0x7fc688007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb94482ef9ea119 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc6757fa640 1 -- 172.21.15.155:0/2403113448 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6880137d0 con 0x563218862a70 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc6757fa640 1 -- 172.21.15.155:0/2403113448 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc688019070 con 0x563218862a70 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.143+0000 7fc6757fa640 1 -- 172.21.15.155:0/2403113448 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688013b70 con 0x563218862a70 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 -- 172.21.15.155:0/2403113448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 msgr2=0x5632188b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188b08a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc688007410 tx=0x7fc688007810 comp rx=0 tx=0).stop 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 -- 172.21.15.155:0/2403113448 shutdown_connections 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188b08a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218861fc0 0x563218865f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 --2- 172.21.15.155:0/2403113448 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862690 0x5632188a6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 -- 172.21.15.155:0/2403113448 >> 172.21.15.155:0/2403113448 conn(0x563218863c80 msgr2=0x563218866580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 -- 172.21.15.155:0/2403113448 shutdown_connections 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 -- 172.21.15.155:0/2403113448 wait complete. 2024-04-25T13:17:17.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 -- start start 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.144+0000 7fc698da9740 1 Processor -- start 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x56321888dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x56321887ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5632188a7700 con 0x563218862a70 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563218766470 con 0x563218862690 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x5632188650e0 con 0x56321887e9f0 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc698da9740 10 client.0 _ll_register_callbacks cb 0x56321878bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x56321888dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x56321888dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45824/0 (socket says 172.21.15.155:45824) 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 -- 172.21.15.155:0/3894371613 learned_addr learned my addr 172.21.15.155:0/3894371613 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68ffff640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x56321887ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 -- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 msgr2=0x56321887ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x56321887ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 -- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 msgr2=0x5632188675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.145+0000 7fc68effd640 1 -- 172.21.15.155:0/3894371613 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632185a86b0 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc68effd640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x56321888dc80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc6840760e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d973a9240affbff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc66e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc66e7fc640 1 -- 172.21.15.155:0/3894371613 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684092380 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc66e7fc640 1 -- 172.21.15.155:0/3894371613 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc6840ac0b0 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc688019070 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc66e7fc640 1 -- 172.21.15.155:0/3894371613 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc6840ac2b0 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 10 client.4860 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x56321888e1c0 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc66e7fc640 1 -- 172.21.15.155:0/3894371613 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc688019070 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc66e7fc640 1 -- 172.21.15.155:0/3894371613 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc68403a030 con 0x563218862a70 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 10 client.4860 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 10 client.4860 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 20 client.4860 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x5632188c51e0 0x5632188c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 4 client.4860 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 --> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632187d9670 con 0x5632188c51e0 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.146+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x5632188c51e0 0x5632188c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc66e7fc640 10 client.4860 ms_handle_connect on v2:172.21.15.155:6838/3774335819 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x5632188c51e0 0x5632188c75d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1a2d9d2ce8d0575 server_cookie=de5c7bbd9a117380 in_seq=0 out_seq=0 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc66e7fc640 1 -- 172.21.15.155:0/3894371613 <== mds.2 v2:172.21.15.155:6838/3774335819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5632187d9670 con 0x5632188c51e0 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc66e7fc640 10 client.4860 handle_command_reply: tid=0 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 client.4860 shutdown 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 msgr2=0x56321888dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x56321888dc80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc684009870 tx=0x7fc6840760e0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 shutdown_connections 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x5632188c51e0 0x5632188c75d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x56321887ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x56321888dc80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc66e7fc640 0 client.4860 ms_handle_reset on v2:172.21.15.155:6838/3774335819 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 --2- 172.21.15.155:0/3894371613 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.147+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 >> 172.21.15.155:0/3894371613 conn(0x563218861fc0 msgr2=0x5632188a5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.148+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 shutdown_connections 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.148+0000 7fc698da9740 1 -- 172.21.15.155:0/3894371613 wait complete. 2024-04-25T13:17:17.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.148+0000 7fc698da9740 20 client.4860 trim_cache size 0 max 16384 2024-04-25T13:17:17.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 Processor -- start 2024-04-25T13:17:17.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 -- start start 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188aa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x563218860940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6901fd0c0 con 0x563218862a70 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x5632188aaca0 con 0x563218862690 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.166+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x5632188a7700 con 0x56321887e9f0 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45830/0 (socket says 172.21.15.155:45830) 2024-04-25T13:17:17.168 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 -- 172.21.15.155:0/2407845178 learned_addr learned my addr 172.21.15.155:0/2407845178 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x563218860940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 -- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 msgr2=0x563218860940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x563218860940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 -- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 msgr2=0x5632188aa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188aa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 -- 172.21.15.155:0/2407845178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321885d290 con 0x563218862a70 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc68effd640 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188aa540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc684078240 tx=0x7fc68407c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0017352deaeb9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc674ff9640 1 -- 172.21.15.155:0/2407845178 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684079850 con 0x563218862a70 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc674ff9640 1 -- 172.21.15.155:0/2407845178 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc684077db0 con 0x563218862a70 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.167+0000 7fc674ff9640 1 -- 172.21.15.155:0/2407845178 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6840aa120 con 0x563218862a70 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 -- 172.21.15.155:0/2407845178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 msgr2=0x5632188aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188aa540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc684078240 tx=0x7fc68407c050 comp rx=0 tx=0).stop 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 -- 172.21.15.155:0/2407845178 shutdown_connections 2024-04-25T13:17:17.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x56321887e9f0 0x563218860940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862a70 0x5632188aa540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 --2- 172.21.15.155:0/2407845178 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563218862690 0x5632188aa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 -- 172.21.15.155:0/2407845178 >> 172.21.15.155:0/2407845178 conn(0x563218861fc0 msgr2=0x563218886140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 -- 172.21.15.155:0/2407845178 shutdown_connections 2024-04-25T13:17:17.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 -- 172.21.15.155:0/2407845178 wait complete. 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.168+0000 7fc698da9740 1 -- start start 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 Processor -- start 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 0x563218860da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862a70 0x563218888df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321887e9f0 0x5632188a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563218888870 con 0x563218862690 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x563218766470 con 0x56321887e9f0 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x563218886f20 con 0x563218862a70 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc698da9740 10 client.0 _ll_register_callbacks cb 0x7fc684079670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.174 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 0x563218860da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc68f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 0x563218860da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45842/0 (socket says 172.21.15.155:45842) 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc68f7fe640 1 -- 172.21.15.155:0/2114874549 learned_addr learned my addr 172.21.15.155:0/2114874549 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc68effd640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862a70 0x563218888df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.169+0000 7fc68ffff640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321887e9f0 0x5632188a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68f7fe640 1 -- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862a70 msgr2=0x563218888df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862a70 0x563218888df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68f7fe640 1 -- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321887e9f0 msgr2=0x5632188a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321887e9f0 0x5632188a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68f7fe640 1 -- 172.21.15.155:0/2114874549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563218875340 con 0x563218862690 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68effd640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862a70 0x563218888df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68f7fe640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 0x563218860da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc68000fd60 tx=0x7fc680012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b560e8e3074f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc66e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.175 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc66e7fc640 1 -- 172.21.15.155:0/2114874549 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68001b040 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc66e7fc640 1 -- 172.21.15.155:0/2114874549 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc680005990 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc684077db0 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc66e7fc640 1 -- 172.21.15.155:0/2114874549 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc680037050 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 10 client.4866 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x563218889330 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc66e7fc640 1 -- 172.21.15.155:0/2114874549 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc684077db0 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc66e7fc640 1 -- 172.21.15.155:0/2114874549 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7fc68003a020 con 0x563218862690 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 10 client.4866 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 10 client.4866 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 20 client.4866 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x56321888c720 0x56321891c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 4 client.4866 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 --> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] -- command(tid 0: {"prefix": "status"}) -- 0x5632187d34e0 con 0x56321888c720 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.170+0000 7fc68effd640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x56321888c720 0x56321891c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.176 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc66e7fc640 10 client.4866 ms_handle_connect on v2:172.21.15.155:6838/3774335819 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc68effd640 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x56321888c720 0x56321891c500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2a1f5968380cc05 server_cookie=1ff55d9bcbd44587 in_seq=0 out_seq=0 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc66e7fc640 1 -- 172.21.15.155:0/2114874549 <== mds.2 v2:172.21.15.155:6838/3774335819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5632187d34e0 con 0x56321888c720 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc66e7fc640 10 client.4866 handle_command_reply: tid=0 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 client.4866 shutdown 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 msgr2=0x563218860da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 0x563218860da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc68000fd60 tx=0x7fc680012000 comp rx=0 tx=0).stop 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 shutdown_connections 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:6838/3774335819,v1:172.21.15.155:6839/3774335819] conn(0x56321888c720 0x56321891c500 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56321887e9f0 0x5632188a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x563218862a70 0x563218888df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 --2- 172.21.15.155:0/2114874549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563218862690 0x563218860da0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 >> 172.21.15.155:0/2114874549 conn(0x563218861fc0 msgr2=0x5632188909f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc66e7fc640 0 client.4866 ms_handle_reset on v2:172.21.15.155:6838/3774335819 2024-04-25T13:17:17.177 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 shutdown_connections 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 1 -- 172.21.15.155:0/2114874549 wait complete. 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.171+0000 7fc698da9740 20 client.4866 trim_cache size 0 max 16384 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "99137c81-994c-40b7-8b7f-aeb03a97ab57", 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 2, 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4284, 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-04-25T13:17:17.178 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-04-25T13:17:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 23.393334497000001, 2024-04-25T13:17:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:17.179 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 62.049003083999999 2024-04-25T13:17:17.179 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c920 msgr2=0x7fc67c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c920 0x7fc67c06ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc680006fd0 tx=0x7fc680008040 comp rx=0 tx=0).stop 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 msgr2=0x7fc690151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 0x7fc690151fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc68402a250 tx=0x7fc6840046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 shutdown_connections 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc67c06c920 0x7fc67c06ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc6900caac0 0x7fc6900cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6900ca6e0 0x7fc690151fd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 --2- 172.21.15.155:0/3269804717 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc6900708b0 0x7fc6901f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 >> 172.21.15.155:0/3269804717 conn(0x7fc69006bd10 msgr2=0x7fc69014fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 shutdown_connections 2024-04-25T13:17:17.180 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.172+0000 7fc695fb4640 1 -- 172.21.15.155:0/3269804717 wait complete. 2024-04-25T13:17:17.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T13:17:17.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.281+0000 7ff1de831640 1 Processor -- start 2024-04-25T13:17:17.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.281+0000 7ff1de831640 1 -- start start 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1de831640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1de831640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1d8155550 0x7ff1d80d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1de831640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d80ccf00 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1de831640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d80cddf0 con 0x7ff1d8155550 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1de831640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d815f430 con 0x7ff1d8155170 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1d8155550 0x7ff1d80d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff1d8155550 0x7ff1d80d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.155:34170/0 (socket says 172.21.15.155:34170) 2024-04-25T13:17:17.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3301/0 says I am v2:172.21.15.155:33234/0 (socket says 172.21.15.155:33234) 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 -- 172.21.15.155:0/1238677130 learned_addr learned my addr 172.21.15.155:0/1238677130 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1dcdce640 1 --1- 172.21.15.155:0/1238677130 >> v1:172.21.15.191:6789/0 conn(0x7ff1d80cb9e0 0x7ff1d80c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:58164/0 (socket says 172.21.15.155:58164) 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 -- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 msgr2=0x7ff1d815eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 -- 172.21.15.155:0/1238677130 >> v1:172.21.15.191:6789/0 conn(0x7ff1d80cb9e0 legacy=0x7ff1d80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d77fe640 1 -- 172.21.15.155:0/1238677130 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d80cd1e0 con 0x7ff1d8155550 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d6ffd640 1 -- 172.21.15.155:0/1238677130 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045434013 0 0) 0x7ff1d80ccf00 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.282+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.283+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d80d0860 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009870 tx=0x7ff1cc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f6fbea9c512cd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.283+0000 7ff1d6ffd640 1 -- 172.21.15.155:0/1238677130 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc037070 con 0x7ff1d8155550 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.283+0000 7ff1d6ffd640 1 -- 172.21.15.155:0/1238677130 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc032440 con 0x7ff1d8155550 2024-04-25T13:17:17.284 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.283+0000 7ff1d6ffd640 1 -- 172.21.15.155:0/1238677130 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc032810 con 0x7ff1d8155550 2024-04-25T13:17:17.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.283+0000 7ff1de831640 1 -- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 msgr2=0x7ff1d80d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.283+0000 7ff1de831640 1 --2- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d80d0860 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009870 tx=0x7ff1cc02a1c0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.284+0000 7ff1de831640 1 -- 172.21.15.155:0/1238677130 shutdown_connections 2024-04-25T13:17:17.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.284+0000 7ff1de831640 1 --2- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d80d0860 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.284+0000 7ff1de831640 1 --2- 172.21.15.155:0/1238677130 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.287 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.284+0000 7ff1de831640 1 -- 172.21.15.155:0/1238677130 >> 172.21.15.155:0/1238677130 conn(0x7ff1d8072570 msgr2=0x7ff1d8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.284+0000 7ff1de831640 1 -- 172.21.15.155:0/1238677130 shutdown_connections 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.284+0000 7ff1de831640 1 -- 172.21.15.155:0/1238677130 wait complete. 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 Processor -- start 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 -- start start 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 0x7ff1d81f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d81e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80cda80 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80cd7a0 con 0x7ff1d8155550 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.285+0000 7ff1de831640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d80ccae0 con 0x7ff1d8155170 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 0x7ff1d81f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 0x7ff1d81f4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45856/0 (socket says 172.21.15.155:45856) 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 -- 172.21.15.155:0/1283358809 learned_addr learned my addr 172.21.15.155:0/1283358809 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d81e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 -- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 msgr2=0x7ff1d815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 -- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 msgr2=0x7ff1d81e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d81e4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 -- 172.21.15.155:0/1283358809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d81e4d40 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d81e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 0x7ff1d81f4ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800e960 tx=0x7ff1c800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d4ff9640 1 -- 172.21.15.155:0/1283358809 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8017070 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d4ff9640 1 -- 172.21.15.155:0/1283358809 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c800ca00 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1d4ff9640 1 -- 172.21.15.155:0/1283358809 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c800cdd0 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d81e5020 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.286+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d81e55e0 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.288+0000 7ff1d4ff9640 1 -- 172.21.15.155:0/1283358809 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1c801a070 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.288+0000 7ff1d4ff9640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff1c406c8f0 0x7ff1c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.289+0000 7ff1d4ff9640 1 -- 172.21.15.155:0/1283358809 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff1c808bcc0 con 0x7ff1d80cb9e0 2024-04-25T13:17:17.296 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.289+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff1c406c8f0 0x7ff1c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.289+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff1c406c8f0 0x7ff1c406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc034000 tx=0x7ff1cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.289+0000 7ff1e1628740 1 Processor -- start 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.289+0000 7ff1e1628740 1 -- start start 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959d6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 0x55b895995f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1e1628740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b8958fbc50 con 0x55b895991fc0 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b895898830 con 0x55b895992a70 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55b8958f7c10 con 0x55b895992690 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 0x55b895995f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 0x55b895995f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45866/0 (socket says 172.21.15.155:45866) 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 -- 172.21.15.155:0/3159275201 learned_addr learned my addr 172.21.15.155:0/3159275201 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959d6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 -- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 msgr2=0x55b8959d6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959d6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 -- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 msgr2=0x55b8959e08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959e08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 -- 172.21.15.155:0/3159275201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89560e2d0 con 0x55b895991fc0 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.290+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 0x55b895995f40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009960 tx=0x7ff1cc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3c49142ed569a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1bdffb640 1 -- 172.21.15.155:0/3159275201 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc037040 con 0x55b895991fc0 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1bdffb640 1 -- 172.21.15.155:0/3159275201 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc04d070 con 0x55b895991fc0 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1bdffb640 1 -- 172.21.15.155:0/3159275201 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc003db0 con 0x55b895991fc0 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 -- 172.21.15.155:0/3159275201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 msgr2=0x55b895995f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 0x55b895995f40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009960 tx=0x7ff1cc02c000 comp rx=0 tx=0).stop 2024-04-25T13:17:17.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 -- 172.21.15.155:0/3159275201 shutdown_connections 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959e08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895991fc0 0x55b895995f40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3159275201 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959d6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 -- 172.21.15.155:0/3159275201 >> 172.21.15.155:0/3159275201 conn(0x55b895993c80 msgr2=0x55b895996580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 -- 172.21.15.155:0/3159275201 shutdown_connections 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.291+0000 7ff1e1628740 1 -- 172.21.15.155:0/3159275201 wait complete. 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.292+0000 7ff1e1628740 1 -- start start 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.292+0000 7ff1e1628740 1 Processor -- start 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 0x55b8959b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8959bc800 0x55b8959e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b8959d7700 con 0x55b895992a70 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b895896470 con 0x55b8959bc800 2024-04-25T13:17:17.299 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55b8959950e0 con 0x55b895992690 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1e1628740 10 client.0 _ll_register_callbacks cb 0x55b8958bbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 0x55b8959b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 0x55b8959b9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45882/0 (socket says 172.21.15.155:45882) 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d77fe640 1 -- 172.21.15.155:0/3909072065 learned_addr learned my addr 172.21.15.155:0/3909072065 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8959bc800 0x55b8959e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 -- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8959bc800 msgr2=0x55b8959e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8959bc800 0x55b8959e23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 -- 172.21.15.155:0/3909072065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 msgr2=0x55b8959b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 0x55b8959b9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 -- 172.21.15.155:0/3909072065 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55b8956d86b0 con 0x55b895992690 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 0x55b8959b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959b6d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8089e50 tx=0x7ff1c8059730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343eb75231f0ee3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.191:3301/0 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/3909072065 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8021030 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.293+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/3909072065 <== mon.2 v2:172.21.15.191:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff1c805ebc0 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1cc04d070 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/3909072065 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff1c8071e60 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 10 client.4664 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b8959e1ec0 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/3909072065 <== mon.2 v2:172.21.15.191:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc04d070 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/3909072065 <== mon.2 v2:172.21.15.191:3301/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7ff1c8024060 con 0x55b895992690 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 10 client.4664 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 10 client.4664 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 20 client.4664 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959b38f0 0x55b8959f7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 4 client.4664 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:17.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 --> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b895909670 con 0x55b8959b38f0 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959b38f0 0x55b8959f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959b38f0 0x55b8959f7540 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82baa24ccb026140 server_cookie=83bf4d4bf9dc8ea7 in_seq=0 out_seq=0 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.294+0000 7ff1b6ffd640 10 client.4664 ms_handle_connect on v2:172.21.15.191:6832/1291944552 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/3909072065 <== mds.1 v2:172.21.15.191:6832/1291944552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b895909670 con 0x55b8959b38f0 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1b6ffd640 10 client.4664 handle_command_reply: tid=0 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 client.4664 shutdown 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 msgr2=0x55b8959b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959b6d10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8089e50 tx=0x7ff1c8059730 comp rx=0 tx=0).stop 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 shutdown_connections 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959b38f0 0x55b8959f7540 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b8959bc800 0x55b8959e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992a70 0x55b8959b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.302 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 --2- 172.21.15.155:0/3909072065 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b8959b6d10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1b6ffd640 0 client.4664 ms_handle_reset on v2:172.21.15.191:6832/1291944552 2024-04-25T13:17:17.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 >> 172.21.15.155:0/3909072065 conn(0x55b895991fc0 msgr2=0x55b8959911d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 shutdown_connections 2024-04-25T13:17:17.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.295+0000 7ff1e1628740 1 -- 172.21.15.155:0/3909072065 wait complete. 2024-04-25T13:17:17.303 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.296+0000 7ff1e1628740 20 client.4664 trim_cache size 0 max 16384 2024-04-25T13:17:17.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.313+0000 7ff1e1628740 1 Processor -- start 2024-04-25T13:17:17.313 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.313+0000 7ff1e1628740 1 -- start start 2024-04-25T13:17:17.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b895990b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959fc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 0x55b8959fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1e1628740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d8156360 con 0x55b8959bc800 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8959d1ad0 con 0x55b895992a70 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55b8959b3770 con 0x55b895992690 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 0x55b8959fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 0x55b8959fcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45892/0 (socket says 172.21.15.155:45892) 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 -- 172.21.15.155:0/2390334622 learned_addr learned my addr 172.21.15.155:0/2390334622 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b895990b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 -- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 msgr2=0x55b895990b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b895990b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 -- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 msgr2=0x55b8959fc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959fc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 -- 172.21.15.155:0/2390334622 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8959b72b0 con 0x55b8959bc800 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 0x55b8959fcd70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0002090 tx=0x7ff1d0004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fb41fa2b6551b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.316 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1bd7fa640 1 -- 172.21.15.155:0/2390334622 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0016630 con 0x55b8959bc800 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1bd7fa640 1 -- 172.21.15.155:0/2390334622 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d00167d0 con 0x55b8959bc800 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.314+0000 7ff1bd7fa640 1 -- 172.21.15.155:0/2390334622 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0016b80 con 0x55b8959bc800 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 -- 172.21.15.155:0/2390334622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 msgr2=0x55b8959fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 0x55b8959fcd70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0002090 tx=0x7ff1d0004cb0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 -- 172.21.15.155:0/2390334622 shutdown_connections 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b8959bc800 0x55b8959fcd70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b8959fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 --2- 172.21.15.155:0/2390334622 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b895992690 0x55b895990b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 -- 172.21.15.155:0/2390334622 >> 172.21.15.155:0/2390334622 conn(0x55b895991fc0 msgr2=0x55b8959d5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 -- 172.21.15.155:0/2390334622 shutdown_connections 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 -- 172.21.15.155:0/2390334622 wait complete. 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.315+0000 7ff1e1628740 1 -- start start 2024-04-25T13:17:17.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 Processor -- start 2024-04-25T13:17:17.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 0x55b8959d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b895a4c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b8959bc800 0x55b895a4ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b8959ebb10 con 0x55b895992690 2024-04-25T13:17:17.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55b8959b3d20 con 0x55b895992a70 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55b8959ec1c0 con 0x55b8959bc800 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1e1628740 10 client.0 _ll_register_callbacks cb 0x7ff1c800cf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 0x55b8959d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1d7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 0x55b8959d7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45894/0 (socket says 172.21.15.155:45894) 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.316+0000 7ff1d7fff640 1 -- 172.21.15.155:0/4077200466 learned_addr learned my addr 172.21.15.155:0/4077200466 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b895a4c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1dcdce640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b8959bc800 0x55b895a4ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d7fff640 1 -- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b8959bc800 msgr2=0x55b895a4ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b8959bc800 0x55b895a4ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d7fff640 1 -- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 msgr2=0x55b895a4c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b895a4c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d7fff640 1 -- 172.21.15.155:0/4077200466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8959b7050 con 0x55b895992690 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b895a4c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:17.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1d7fff640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 0x55b8959d7780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009250 tx=0x7ff1c8089d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d4f3c5e6509a9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/4077200466 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8021070 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/4077200466 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff1c805ebc0 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1d00167d0 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/4077200466 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7ff1c8081050 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 10 client.4881 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55b89598d6e0 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/4077200466 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d00167d0 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/4077200466 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7ff1c80832f0 con 0x55b895992690 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 10 client.4881 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 10 client.4881 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 20 client.4881 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959d51e0 0x55b895a5f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 4 client.4881 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.317+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 --> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] -- command(tid 0: {"prefix": "status"}) -- 0x55b8959034e0 con 0x55b8959d51e0 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959d51e0 0x55b895a5f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1b6ffd640 10 client.4881 ms_handle_connect on v2:172.21.15.191:6832/1291944552 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1d77fe640 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959d51e0 0x55b895a5f0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f38e6e4249c1a6b server_cookie=2c7af9c7c95dfb17 in_seq=0 out_seq=0 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1b6ffd640 1 -- 172.21.15.155:0/4077200466 <== mds.1 v2:172.21.15.191:6832/1291944552 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55b8959034e0 con 0x55b8959d51e0 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1b6ffd640 10 client.4881 handle_command_reply: tid=0 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 client.4881 shutdown 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 msgr2=0x55b8959d7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 0x55b8959d7780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009250 tx=0x7ff1c8089d50 comp rx=0 tx=0).stop 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 shutdown_connections 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:6832/1291944552,v1:172.21.15.191:6834/1291944552] conn(0x55b8959d51e0 0x55b895a5f0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55b8959bc800 0x55b895a4ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1b6ffd640 0 client.4881 ms_handle_reset on v2:172.21.15.191:6832/1291944552 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b895992a70 0x55b895a4c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 --2- 172.21.15.155:0/4077200466 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b895992690 0x55b8959d7780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 >> 172.21.15.155:0/4077200466 conn(0x55b895991fc0 msgr2=0x55b89598ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 shutdown_connections 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 1 -- 172.21.15.155:0/4077200466 wait complete. 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.318+0000 7ff1e1628740 20 client.4881 trim_cache size 0 max 16384 2024-04-25T13:17:17.325 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "99137c81-994c-40b7-8b7f-aeb03a97ab57", 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 1, 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4297, 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 28.574544353, 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 62.181104996000002 2024-04-25T13:17:17.326 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:17.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff1c406c8f0 msgr2=0x7ff1c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff1c406c8f0 0x7ff1c406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc034000 tx=0x7ff1cc02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:17.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 msgr2=0x7ff1d81f4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 0x7ff1d81f4ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800e960 tx=0x7ff1c800ee20 comp rx=0 tx=0).stop 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 shutdown_connections 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1d8155550 0x7ff1d81e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff1c406c8f0 0x7ff1c406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff1d8155170 0x7ff1d815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 --2- 172.21.15.155:0/1283358809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1d80cb9e0 0x7ff1d81f4ec0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 >> 172.21.15.155:0/1283358809 conn(0x7ff1d8072570 msgr2=0x7ff1d81539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 shutdown_connections 2024-04-25T13:17:17.328 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.319+0000 7ff1de831640 1 -- 172.21.15.155:0/1283358809 wait complete. 2024-04-25T13:17:17.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:17:17.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.429+0000 7f0becd9b640 1 Processor -- start 2024-04-25T13:17:17.429 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.429+0000 7f0becd9b640 1 -- start start 2024-04-25T13:17:17.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0becd9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0becd9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0be80cb9e0 0x7f0be80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0becd9b640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be80ccf00 con 0x7f0be8155550 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0becd9b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0be80cddf0 con 0x7f0be80cb9e0 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0becd9b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0be815f430 con 0x7f0be8155170 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0be80cb9e0 0x7f0be80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0be80cb9e0 0x7f0be80c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45910/0 (socket says 172.21.15.155:45910) 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3721692444 learned_addr learned my addr 172.21.15.155:0/3721692444 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be659c640 1 --2- 172.21.15.155:0/3721692444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3721692444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 msgr2=0x7f0be815eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3721692444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be815eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3721692444 >> v1:172.21.15.191:6789/0 conn(0x7f0be8155550 legacy=0x7f0be80d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3721692444 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be80cd1e0 con 0x7f0be80cb9e0 2024-04-25T13:17:17.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.430+0000 7f0be559a640 1 -- 172.21.15.155:0/3721692444 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669635397 0 0) 0x7f0be80ccf00 con 0x7f0be8155550 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.431+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3721692444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be80cb9e0 0x7f0be80c5810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009e50 tx=0x7f0be002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1503f48019428435 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.431+0000 7f0be559a640 1 -- 172.21.15.155:0/3721692444 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0036070 con 0x7f0be80cb9e0 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.431+0000 7f0be559a640 1 -- 172.21.15.155:0/3721692444 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0031600 con 0x7f0be80cb9e0 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.431+0000 7f0be559a640 1 -- 172.21.15.155:0/3721692444 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00319d0 con 0x7f0be80cb9e0 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 -- 172.21.15.155:0/3721692444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be80cb9e0 msgr2=0x7f0be80c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3721692444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be80cb9e0 0x7f0be80c5810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009e50 tx=0x7f0be002a680 comp rx=0 tx=0).stop 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 -- 172.21.15.155:0/3721692444 shutdown_connections 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3721692444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be80cb9e0 0x7f0be80c5810 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.433 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3721692444 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be815eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 -- 172.21.15.155:0/3721692444 >> 172.21.15.155:0/3721692444 conn(0x7f0be8072570 msgr2=0x7f0be8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 -- 172.21.15.155:0/3721692444 shutdown_connections 2024-04-25T13:17:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.432+0000 7f0becd9b640 1 -- 172.21.15.155:0/3721692444 wait complete. 2024-04-25T13:17:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.433+0000 7f0becd9b640 1 Processor -- start 2024-04-25T13:17:17.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.433+0000 7f0becd9b640 1 -- start start 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be80cb9e0 0x7f0be815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be81f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 0x7f0be81f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0be80cda80 con 0x7f0be8155550 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0be80cd7a0 con 0x7f0be80cb9e0 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0be80ccae0 con 0x7f0be8155170 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 0x7f0be81f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be80cb9e0 0x7f0be815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 0x7f0be81f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45916/0 (socket says 172.21.15.155:45916) 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3657996666 learned_addr learned my addr 172.21.15.155:0/3657996666 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be81f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.436 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 msgr2=0x7f0be81f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be81f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be80cb9e0 msgr2=0x7f0be815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be80cb9e0 0x7f0be815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3657996666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be815a6a0 con 0x7f0be8155550 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be659c640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be80cb9e0 0x7f0be815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be81f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 0x7f0be81f4930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009f70 tx=0x7f0be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0bd6ffd640 1 -- 172.21.15.155:0/3657996666 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be003f020 con 0x7f0be8155550 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0bd6ffd640 1 -- 172.21.15.155:0/3657996666 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0037040 con 0x7f0be8155550 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0bd6ffd640 1 -- 172.21.15.155:0/3657996666 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0036070 con 0x7f0be8155550 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.434+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be815c060 con 0x7f0be8155550 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.435+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81512d0 con 0x7f0be8155550 2024-04-25T13:17:17.437 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.436+0000 7f0bd6ffd640 1 -- 172.21.15.155:0/3657996666 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0be0042020 con 0x7f0be8155550 2024-04-25T13:17:17.440 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.436+0000 7f0bd6ffd640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0bc806c920 0x7f0bc806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.436+0000 7f0bd6ffd640 1 -- 172.21.15.155:0/3657996666 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0be00ac260 con 0x7f0be8155550 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.436+0000 7f0be659c640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0bc806c920 0x7f0bc806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.437+0000 7f0be659c640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0bc806c920 0x7f0bc806ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009f30 tx=0x7f0bd8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.437+0000 7f0befb8c740 1 Processor -- start 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 -- start start 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f259a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f214fc0 0x55c05f218f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f2638a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c05f17ec50 con 0x55c05f215a70 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c05f11b830 con 0x55c05f215690 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55c05f17ac10 con 0x55c05f214fc0 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f2638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.441 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f2638a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45930/0 (socket says 172.21.15.155:45930) 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3401958560 learned_addr learned my addr 172.21.15.155:0/3401958560 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f214fc0 0x55c05f218f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.438+0000 7f0be659c640 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f259a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f214fc0 msgr2=0x55c05f218f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f214fc0 0x55c05f218f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 msgr2=0x55c05f259a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f259a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0be6d9d640 1 -- 172.21.15.155:0/3401958560 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05ee912d0 con 0x55c05f215a70 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f2638a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0be00aa300 tx=0x7f0be00797f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7fcdaab730555e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0bc7fff640 1 -- 172.21.15.155:0/3401958560 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0092020 con 0x55c05f215a70 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0bc7fff640 1 -- 172.21.15.155:0/3401958560 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0079bb0 con 0x55c05f215a70 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.439+0000 7f0bc7fff640 1 -- 172.21.15.155:0/3401958560 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00ac0c0 con 0x55c05f215a70 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 -- 172.21.15.155:0/3401958560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 msgr2=0x55c05f2638a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.442 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f2638a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0be00aa300 tx=0x7f0be00797f0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 -- 172.21.15.155:0/3401958560 shutdown_connections 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f2638a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f214fc0 0x55c05f218f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 --2- 172.21.15.155:0/3401958560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f259a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 -- 172.21.15.155:0/3401958560 >> 172.21.15.155:0/3401958560 conn(0x55c05f216c80 msgr2=0x55c05f219580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 -- 172.21.15.155:0/3401958560 shutdown_connections 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 -- 172.21.15.155:0/3401958560 wait complete. 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 -- start start 2024-04-25T13:17:17.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.440+0000 7f0befb8c740 1 Processor -- start 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 0x55c05f23b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215a70 0x55c05f241f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f240700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c05f25a700 con 0x55c05f215690 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c05f119470 con 0x55c05f215a70 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55c05f17ec50 con 0x55c05f2402c0 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0befb8c740 10 client.0 _ll_register_callbacks cb 0x55c05f13ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0be659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 0x55c05f23b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0be659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 0x55c05f23b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45944/0 (socket says 172.21.15.155:45944) 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0be659c640 1 -- 172.21.15.155:0/2449927276 learned_addr learned my addr 172.21.15.155:0/2449927276 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215a70 0x55c05f241f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.441+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f240700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0be659c640 1 -- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 msgr2=0x55c05f240700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0be659c640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f240700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0be659c640 1 -- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215a70 msgr2=0x55c05f241f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0be659c640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215a70 0x55c05f241f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0be659c640 1 -- 172.21.15.155:0/2449927276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05ef5b6b0 con 0x55c05f215690 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0be659c640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 0x55c05f23b0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8003b90 tx=0x7f0bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b04b2a8b6c983d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0bc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0bc57fa640 1 -- 172.21.15.155:0/2449927276 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8027070 con 0x55c05f215690 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0bc57fa640 1 -- 172.21.15.155:0/2449927276 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0bd80149c0 con 0x55c05f215690 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0be0079bb0 con 0x55c05f215690 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0bc57fa640 1 -- 172.21.15.155:0/2449927276 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0bd8014bc0 con 0x55c05f215690 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 10 client.4893 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c05f23a610 con 0x55c05f215690 2024-04-25T13:17:17.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0bc57fa640 1 -- 172.21.15.155:0/2449927276 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0079bb0 con 0x55c05f215690 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0bc57fa640 1 -- 172.21.15.155:0/2449927276 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0bd8035080 con 0x55c05f215690 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 10 client.4893 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 10 client.4893 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 20 client.4893 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f277fb0 0x55c05f27a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 4 client.4893 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.442+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 --> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c05f18c670 con 0x55c05f277fb0 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.443+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f277fb0 0x55c05f27a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.443+0000 7f0bc57fa640 10 client.4893 ms_handle_connect on v2:172.21.15.191:6835/2351082662 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.443+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f277fb0 0x55c05f27a3a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab95bcacb8d78c8e server_cookie=5b97210dcf9b1c98 in_seq=0 out_seq=0 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.443+0000 7f0bc57fa640 1 -- 172.21.15.155:0/2449927276 <== mds.0 v2:172.21.15.191:6835/2351082662 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c05f18c670 con 0x55c05f277fb0 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.443+0000 7f0bc57fa640 10 client.4893 handle_command_reply: tid=0 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.443+0000 7f0befb8c740 1 client.4893 shutdown 2024-04-25T13:17:17.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 msgr2=0x55c05f23b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 0x55c05f23b0e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8003b90 tx=0x7f0bd80046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 shutdown_connections 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f277fb0 0x55c05f27a3a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f240700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0bc57fa640 0 client.4893 ms_handle_reset on v2:172.21.15.191:6835/2351082662 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215a70 0x55c05f241f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 --2- 172.21.15.155:0/2449927276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215690 0x55c05f23b0e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 >> 172.21.15.155:0/2449927276 conn(0x55c05f214fc0 msgr2=0x55c05f213940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 shutdown_connections 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 1 -- 172.21.15.155:0/2449927276 wait complete. 2024-04-25T13:17:17.450 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.444+0000 7f0befb8c740 20 client.4893 trim_cache size 0 max 16384 2024-04-25T13:17:17.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 Processor -- start 2024-04-25T13:17:17.462 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 -- start start 2024-04-25T13:17:17.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f23b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f23bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f2743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81fed00 con 0x55c05f215a70 2024-04-25T13:17:17.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81f18f0 con 0x55c05f215690 2024-04-25T13:17:17.464 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55c05f25c190 con 0x55c05f2402c0 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.462+0000 7f0be5d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f23bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f23bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45948/0 (socket says 172.21.15.155:45948) 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 -- 172.21.15.155:0/960231950 learned_addr learned my addr 172.21.15.155:0/960231950 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be659c640 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f23b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f2743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 -- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 msgr2=0x55c05f2743e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f2743e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 -- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 msgr2=0x55c05f23b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f23b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 -- 172.21.15.155:0/960231950 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05f21b9f0 con 0x55c05f215a70 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f23bc20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc000f60 tx=0x7f0bdc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5ea875a191865a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0bc77fe640 1 -- 172.21.15.155:0/960231950 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc024070 con 0x55c05f215a70 2024-04-25T13:17:17.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0bc77fe640 1 -- 172.21.15.155:0/960231950 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc01edf0 con 0x55c05f215a70 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0bc77fe640 1 -- 172.21.15.155:0/960231950 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc0052f0 con 0x55c05f215a70 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0befb8c740 1 -- 172.21.15.155:0/960231950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 msgr2=0x55c05f23bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.463+0000 7f0befb8c740 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f23bc20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc000f60 tx=0x7f0bdc009040 comp rx=0 tx=0).stop 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 -- 172.21.15.155:0/960231950 shutdown_connections 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f2402c0 0x55c05f2743e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f215a70 0x55c05f23bc20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 --2- 172.21.15.155:0/960231950 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f23b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 -- 172.21.15.155:0/960231950 >> 172.21.15.155:0/960231950 conn(0x55c05f214fc0 msgr2=0x55c05f214820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 -- 172.21.15.155:0/960231950 shutdown_connections 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 -- 172.21.15.155:0/960231950 wait complete. 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 -- start start 2024-04-25T13:17:17.466 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.464+0000 7f0befb8c740 1 Processor -- start 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f235930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f215a70 0x55c05f27e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 0x55c05f234be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c05f239d80 con 0x55c05f2402c0 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x55c05f240c40 con 0x55c05f215690 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x55c05f26ed20 con 0x55c05f215a70 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0befb8c740 10 client.0 _ll_register_callbacks cb 0x7f0bd8009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 0x55c05f234be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 0x55c05f234be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45958/0 (socket says 172.21.15.155:45958) 2024-04-25T13:17:17.470 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 -- 172.21.15.155:0/823002772 learned_addr learned my addr 172.21.15.155:0/823002772 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be659c640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f235930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be5d9b640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f215a70 0x55c05f27e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 -- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f215a70 msgr2=0x55c05f27e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f215a70 0x55c05f27e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 -- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 msgr2=0x55c05f235930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f235930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.465+0000 7f0be6d9d640 1 -- 172.21.15.155:0/823002772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05f2429e0 con 0x55c05f2402c0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0be6d9d640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 0x55c05f234be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0be00aa3e0 tx=0x7f0be0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8cfc2c11cc2813 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0bc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0bc57fa640 1 -- 172.21.15.155:0/823002772 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be009e060 con 0x55c05f2402c0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0bc57fa640 1 -- 172.21.15.155:0/823002772 <== mon.0 v2:172.21.15.155:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0be0076220 con 0x55c05f2402c0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bdc01edf0 con 0x55c05f2402c0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0bc57fa640 1 -- 172.21.15.155:0/823002772 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f0be0092040 con 0x55c05f2402c0 2024-04-25T13:17:17.471 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 10 client.4899 fetch_fsmap learned FSMap version 18 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c05f27ed60 con 0x55c05f2402c0 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0bc57fa640 1 -- 172.21.15.155:0/823002772 <== mon.0 v2:172.21.15.155:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bdc01edf0 con 0x55c05f2402c0 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0bc57fa640 1 -- 172.21.15.155:0/823002772 <== mon.0 v2:172.21.15.155:3300/0 5 ==== fsmap(e 18) ==== 4792+0+0 (secure 0 0 0) 0x7f0be00822e0 con 0x55c05f2402c0 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 10 client.4899 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 10 client.4899 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 20 client.4899 populate_metadata read hostname 'smithi155' 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f2d9530 0x55c05f2d9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 4 client.4899 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 --> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] -- command(tid 0: {"prefix": "status"}) -- 0x55c05f25a4b0 con 0x55c05f2d9530 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.466+0000 7f0be659c640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f2d9530 0x55c05f2d9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0be659c640 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f2d9530 0x55c05f2d9910 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ce2ce0f6903eb73 server_cookie=94f68d17397a33a3 in_seq=0 out_seq=0 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0bc57fa640 10 client.4899 ms_handle_connect on v2:172.21.15.191:6835/2351082662 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0bc57fa640 1 -- 172.21.15.155:0/823002772 <== mds.0 v2:172.21.15.191:6835/2351082662 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c05f25a4b0 con 0x55c05f2d9530 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0bc57fa640 10 client.4899 handle_command_reply: tid=0 2024-04-25T13:17:17.472 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 client.4899 shutdown 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 msgr2=0x55c05f234be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 0x55c05f234be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0be00aa3e0 tx=0x7f0be0009810 comp rx=0 tx=0).stop 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 shutdown_connections 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:6835/2351082662,v1:172.21.15.191:6837/2351082662] conn(0x55c05f2d9530 0x55c05f2d9910 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c05f2402c0 0x55c05f234be0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0bc57fa640 0 client.4899 ms_handle_reset on v2:172.21.15.191:6835/2351082662 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x55c05f215a70 0x55c05f27e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 --2- 172.21.15.155:0/823002772 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c05f215690 0x55c05f235930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 >> 172.21.15.155:0/823002772 conn(0x55c05f214fc0 msgr2=0x55c05f23b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 shutdown_connections 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 1 -- 172.21.15.155:0/823002772 wait complete. 2024-04-25T13:17:17.473 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.467+0000 7f0befb8c740 20 client.4899 trim_cache size 0 max 16384 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "cluster_fsid": "99137c81-994c-40b7-8b7f-aeb03a97ab57", 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "whoami": 0, 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4305, 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "want_state": "up:active", 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "state": "up:active", 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs", 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "rank_uptime": 55.806336047000002, 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "mdsmap_epoch": 18, 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch": 27, 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T13:17:17.474 INFO:teuthology.orchestra.run.smithi155.stdout: "uptime": 62.328707575000003 2024-04-25T13:17:17.475 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:17.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0bc806c920 msgr2=0x7f0bc806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0bc806c920 0x7f0bc806ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009f30 tx=0x7f0bd8009190 comp rx=0 tx=0).stop 2024-04-25T13:17:17.475 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 msgr2=0x7f0be81f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 0x7f0be81f4930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009f70 tx=0x7f0be0004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 shutdown_connections 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8155550 0x7f0be81f4930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0bc806c920 0x7f0bc806ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0be8155170 0x7f0be81f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 --2- 172.21.15.155:0/3657996666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be80cb9e0 0x7f0be815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 >> 172.21.15.155:0/3657996666 conn(0x7f0be8072570 msgr2=0x7f0be80ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 shutdown_connections 2024-04-25T13:17:17.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.468+0000 7f0becd9b640 1 -- 172.21.15.155:0/3657996666 wait complete. 2024-04-25T13:17:17.479 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T13:17:17.488 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T13:17:17.488 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T13:17:17.489 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T13:17:17.489 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T13:17:17.501 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T13:17:17.501 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T13:17:17.501 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T13:17:17.501 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:17:17.501 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:17.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:17.502 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T13:17:17.517 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T13:17:17.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:17.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T13:17:17.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:17.581 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-25T13:17:17.679 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T13:17:17.679 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:17:17.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.778+0000 7f6e79987640 1 Processor -- start 2024-04-25T13:17:17.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.778+0000 7f6e79987640 1 -- start start 2024-04-25T13:17:17.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e79987640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f6e740c3320 0x7f6e740b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.781 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e79987640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 0x7f6e740c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e79987640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e74155880 con 0x7f6e741554a0 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e79987640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f6e740c9030 con 0x7f6e740c3320 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e79987640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e740c9280 con 0x7f6e7406d020 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e72ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6e741554a0 0x7f6e7415eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55454/0 (socket says 172.21.15.155:55454) 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e72ffd640 1 -- 172.21.15.155:0/1565646979 learned_addr learned my addr 172.21.15.155:0/1565646979 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e6bfff640 1 --2- 172.21.15.155:0/1565646979 >> v2:172.21.15.191:3300/0 conn(0x7f6e740c3320 0x7f6e740b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157336047 0 0) 0x7f6e74155880 con 0x7f6e741554a0 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e60003520 con 0x7f6e741554a0 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e737fe640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 0x7f6e740c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1072695635 0 0) 0x7f6e60003520 con 0x7f6e741554a0 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 msgr2=0x7f6e740c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 0x7f6e740c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 >> v2:172.21.15.191:3300/0 conn(0x7f6e740c3320 msgr2=0x7f6e740b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 --2- 172.21.15.155:0/1565646979 >> v2:172.21.15.191:3300/0 conn(0x7f6e740c3320 0x7f6e740b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e740c9560 con 0x7f6e741554a0 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f6e64001690 con 0x7f6e741554a0 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e6bfff640 1 --2- 172.21.15.155:0/1565646979 >> v2:172.21.15.191:3300/0 conn(0x7f6e740c3320 0x7f6e740b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 >> v1:172.21.15.155:6789/0 conn(0x7f6e741554a0 legacy=0x7f6e7415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e600039b0 0x7f6e60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 0x7f6e60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004d40 0x7f6e600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e740c9030 con 0x7f6e60004d40 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e740c9280 con 0x7f6e600039b0 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e6000b9c0 con 0x7f6e7406d020 2024-04-25T13:17:17.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.779+0000 7f6e737fe640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004d40 0x7f6e600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e72ffd640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e600039b0 0x7f6e60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e6bfff640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 0x7f6e60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e737fe640 1 -- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 msgr2=0x7f6e60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e737fe640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e7406d020 0x7f6e60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e737fe640 1 -- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e600039b0 msgr2=0x7f6e60003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e737fe640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e600039b0 0x7f6e60003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e737fe640 1 -- 172.21.15.155:0/1565646979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e60003520 con 0x7f6e60004d40 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.780+0000 7f6e737fe640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004d40 0x7f6e600051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009f90 tx=0x7f6e60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a1c6fad3985b9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c009c10 con 0x7f6e60004d40 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6c036070 con 0x7f6e60004d40 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e727fc640 1 -- 172.21.15.155:0/1565646979 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c031850 con 0x7f6e60004d40 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e79987640 1 -- 172.21.15.155:0/1565646979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004d40 msgr2=0x7f6e600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e79987640 1 --2- 172.21.15.155:0/1565646979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e60004d40 0x7f6e600051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009f90 tx=0x7f6e60005830 comp rx=0 tx=0).stop 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e737fe640 1 -- 172.21.15.155:0/1565646979 reap_dead start 2024-04-25T13:17:17.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e79987640 1 -- 172.21.15.155:0/1565646979 shutdown_connections 2024-04-25T13:17:17.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e79987640 1 -- 172.21.15.155:0/1565646979 >> 172.21.15.155:0/1565646979 conn(0x7f6e740c9a70 msgr2=0x7f6e740c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:17.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e79987640 1 -- 172.21.15.155:0/1565646979 shutdown_connections 2024-04-25T13:17:17.785 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.781+0000 7f6e79987640 1 -- 172.21.15.155:0/1565646979 wait complete. 2024-04-25T13:17:17.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.782+0000 7f6e79987640 1 Processor -- start 2024-04-25T13:17:17.787 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.782+0000 7f6e79987640 1 -- start start 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e79987640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e741e7880 0x7f6e741f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e79987640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 0x7f6e7415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e79987640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e740c6dd0 0x7f6e7415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e79987640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e740c7970 con 0x7f6e741e7c60 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e79987640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7415ead0 con 0x7f6e740c6dd0 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e79987640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f6e740c7af0 con 0x7f6e741e7880 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 0x7f6e7415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 0x7f6e7415d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45984/0 (socket says 172.21.15.155:45984) 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 -- 172.21.15.155:0/3601105860 learned_addr learned my addr 172.21.15.155:0/3601105860 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e72ffd640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e741e7880 0x7f6e741f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e737fe640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e740c6dd0 0x7f6e7415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 -- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e741e7880 msgr2=0x7f6e741f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e741e7880 0x7f6e741f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.788 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 -- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e740c6dd0 msgr2=0x7f6e7415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.783+0000 7f6e6bfff640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e740c6dd0 0x7f6e7415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e6bfff640 1 -- 172.21.15.155:0/3601105860 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e741f12f0 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e6bfff640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 0x7f6e7415d6e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011cd0 tx=0x7f6e5c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00fcc0 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c00fe60 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7415c9e0 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c004240 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.784+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7415cca0 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.785+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e74068e40 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.785+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e5c012040 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.786+0000 7f6e70ff9640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e5406c920 0x7f6e5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.786+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6e5c08c460 con 0x7f6e741e7c60 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.786+0000 7f6e72ffd640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e5406c920 0x7f6e5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:17.789 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.786+0000 7f6e72ffd640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e5406c920 0x7f6e5406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e64004840 tx=0x7f6e640078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:17.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:17.790+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6e5c019030 con 0x7f6e741e7c60 2024-04-25T13:17:18.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.005+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6e740cba00 con 0x7f6e741e7c60 2024-04-25T13:17:18.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.006+0000 7f6e70ff9640 1 -- 172.21.15.155:0/3601105860 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+88 (secure 0 0 0) 0x7f6e5c059db0 con 0x7f6e741e7c60 2024-04-25T13:17:18.006 INFO:teuthology.orchestra.run.smithi155.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e5406c920 msgr2=0x7f6e5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e5406c920 0x7f6e5406ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6e64004840 tx=0x7f6e640078f0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 msgr2=0x7f6e7415d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 0x7f6e7415d6e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c011cd0 tx=0x7f6e5c00f610 comp rx=0 tx=0).stop 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 shutdown_connections 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e740c6dd0 0x7f6e7415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.007+0000 7f6e79987640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e741e7c60 0x7f6e7415d6e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.008+0000 7f6e79987640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f6e5406c920 0x7f6e5406ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.008+0000 7f6e79987640 1 --2- 172.21.15.155:0/3601105860 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f6e741e7880 0x7f6e741f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.008+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 >> 172.21.15.155:0/3601105860 conn(0x7f6e740c9a70 msgr2=0x7f6e740cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.008+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 shutdown_connections 2024-04-25T13:17:18.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18.008+0000 7f6e79987640 1 -- 172.21.15.155:0/3601105860 wait complete. 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:17:18.019 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:17:18.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:18.019 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-04-25T13:17:18.034 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:17:18.034 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:17:18.035 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-04-25T13:17:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T13:17:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42686sec preferred_lft 42686sec 2024-04-25T13:17:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ff1:516:a0c2:65b7/64 scope link noprefixroute 2024-04-25T13:17:18.036 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:17:18.036 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:17:18.036 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:17:18.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:18.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:18.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:18.169 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:17:18.191 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-04-25T13:17:18.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:18.192 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-04-25T13:17:18.248 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-04-25T13:17:18.248 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:17:18.248 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:17:18.248 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:17:18.248 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:17:18.249 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:18.249 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:17:18.249 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:17:18.249 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:17:18.249 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:17:18.249 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:17:18.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:18.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:18.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:18.372 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T13:17:18.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:18.388 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-04-25T13:17:18.442 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:18.443 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:17:18.443 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:18.443 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T13:17:18.443 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:17:18.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:18.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:18.558 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T13:17:18.558 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:18.558 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:17:18.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T13:17:18.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:17:18.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T13:17:18.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T13:17:18.559 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T13:17:18.559 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:17:18.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:18.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:18.667 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:17:18.667 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-04-25T13:17:18.667 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-04-25T13:17:18.667 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:17:18.667 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-04-25T13:17:18.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:17:18.736 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:18.742 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T13:17:18.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:17:18.743 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:18.757 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:17:18.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:17:18.757 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:18.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T13:17:18.876 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:18.931 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T13:17:18.931 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T13:17:18.931 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T13:17:18.932 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:18.933 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:18.934 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T13:17:18.934 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:18.934 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:18.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:18.934 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T13:17:18.987 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T13:17:18.987 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T13:17:19.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo modprobe fuse 2024-04-25T13:17:19.052 DEBUG:teuthology.orchestra.run.smithi155:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T13:17:19.108 INFO:teuthology.orchestra.run.smithi155.stdout:/proc 2024-04-25T13:17:19.108 INFO:teuthology.orchestra.run.smithi155.stdout:/sys 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/dev 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/security 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/shm 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/pts 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/run 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/cgroup 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/pstore 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/bpf 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/ 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/selinux 2024-04-25T13:17:19.109 INFO:teuthology.orchestra.run.smithi155.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/hugepages 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/dev/mqueue 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/debug 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/tracing 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/fs/fuse/connections 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/sys/kernel/config 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/run/user/1000 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph 2024-04-25T13:17:19.110 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run.smithi155.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run.smithi155.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:19.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:19.111 DEBUG:teuthology.orchestra.run.smithi155:> ls /sys/fs/fuse/connections 2024-04-25T13:17:19.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:2024-04-25T13:17:19.109+0000 7fc449bee480 -1 init, newargv = 0x558817ab5940 newargc=15 2024-04-25T13:17:19.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[46184]: starting ceph client 2024-04-25T13:17:19.123 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[46184]: starting fuse 2024-04-25T13:17:19.137 INFO:teuthology.orchestra.run.smithi155.stdout:42 2024-04-25T13:17:19.137 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> sudo stdin-killer -- python3 -c ' 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> import glob 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> import re 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> import os 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> import subprocess 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> def _find_admin_socket(client_name): 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> files = glob.glob(asok_path) 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> # Given a non-glob path, it better be there 2024-04-25T13:17:19.138 DEBUG:teuthology.orchestra.run.smithi155:> if "*" not in asok_path: 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> assert(len(files) == 1) 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> return files[0] 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> for f in files: 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> contents = proc_f.read() 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> if mountpoint in contents: 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> return f 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> print(_find_admin_socket("client.0")) 2024-04-25T13:17:19.139 DEBUG:teuthology.orchestra.run.smithi155:> ' 2024-04-25T13:17:19.254 INFO:teuthology.orchestra.run.smithi155.stdout:/var/run/ceph/ceph-client.0.46184.asok 2024-04-25T13:17:19.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:17:19.264 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46184.asok 2024-04-25T13:17:19.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:19.265 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46184.asok status 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "metadata": { 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "entity_id": "0", 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "hostname": "smithi155", 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "pid": "46184", 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "root": "/" 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_count": 0, 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "dentry_pinned_count": 0, 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "id": 4908, 2024-04-25T13:17:19.396 INFO:teuthology.orchestra.run.smithi155.stdout: "inst": { 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "name": { 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "client", 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "num": 4908 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 629389912 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": { 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "type": "v1", 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr": "192.168.0.1:0", 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "nonce": 629389912 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "inst_str": "client.4908 192.168.0.1:0/629389912", 2024-04-25T13:17:19.397 INFO:teuthology.orchestra.run.smithi155.stdout: "addr_str": "192.168.0.1:0/629389912", 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "inode_count": 1, 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_epoch": 18, 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch": 27, 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_epoch_barrier": 0, 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "blocklisted": false, 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout: "fs_name": "cephfs" 2024-04-25T13:17:19.398 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:19.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:19.404 DEBUG:teuthology.orchestra.run.smithi155:> stat --file-system '--printf=%T 2024-04-25T13:17:19.404 DEBUG:teuthology.orchestra.run.smithi155:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:19.419 INFO:teuthology.orchestra.run.smithi155.stdout:fuseblk 2024-04-25T13:17:19.419 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:19.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:19.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:19.483 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T13:17:19.495 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T13:17:19.701 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4f0c8adf883146ce8a9f49292454cb5b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T13:17:19.703 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T13:17:19.711 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T13:17:19.720 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T13:17:19.720 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:17:19.721 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:19.739 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:17:19.739 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:19.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:19.933 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.933+0000 7f5abb3bf640 1 Processor -- start 2024-04-25T13:17:19.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.933+0000 7f5abb3bf640 1 -- start start 2024-04-25T13:17:19.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5abb3bf640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f5ab40b2c70 0x7f5ab40722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5abb3bf640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab415cf40 con 0x7f5ab4074370 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5abb3bf640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab4071a50 con 0x7f5ab40c9220 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5abb3bf640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab40720a0 con 0x7f5ab40b2c70 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5ab895a640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5ab4074370 0x7f5ab40c8b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55462/0 (socket says 172.21.15.155:55462) 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5ab895a640 1 -- 172.21.15.155:0/1309978635 learned_addr learned my addr 172.21.15.155:0/1309978635 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.934+0000 7f5ab915b640 1 --2- 172.21.15.155:0/1309978635 >> v2:172.21.15.191:3300/0 conn(0x7f5ab40b2c70 0x7f5ab40722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.935+0000 7f5aabfff640 1 -- 172.21.15.155:0/1309978635 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478341681 0 0) 0x7f5ab415cf40 con 0x7f5ab4074370 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.935+0000 7f5aabfff640 1 -- 172.21.15.155:0/1309978635 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa0003520 con 0x7f5ab4074370 2024-04-25T13:17:19.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.935+0000 7f5ab915b640 1 -- 172.21.15.155:0/1309978635 >> v1:172.21.15.191:6789/0 conn(0x7f5ab40c9220 legacy=0x7f5ab4163700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.935+0000 7f5ab915b640 1 -- 172.21.15.155:0/1309978635 >> v1:172.21.15.155:6789/0 conn(0x7f5ab4074370 legacy=0x7f5ab40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.935+0000 7f5ab915b640 1 -- 172.21.15.155:0/1309978635 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab4071d30 con 0x7f5ab40b2c70 2024-04-25T13:17:19.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.935+0000 7f5ab915b640 1 --2- 172.21.15.155:0/1309978635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40b2c70 0x7f5ab40722e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009d90 tx=0x7f5ab002a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cebde1aeed8e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5aabfff640 1 -- 172.21.15.155:0/1309978635 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0037070 con 0x7f5ab40b2c70 2024-04-25T13:17:19.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5aabfff640 1 -- 172.21.15.155:0/1309978635 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab0007740 con 0x7f5ab40b2c70 2024-04-25T13:17:19.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5aabfff640 1 -- 172.21.15.155:0/1309978635 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0007af0 con 0x7f5ab40b2c70 2024-04-25T13:17:19.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 -- 172.21.15.155:0/1309978635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40b2c70 msgr2=0x7f5ab40722e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/1309978635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40b2c70 0x7f5ab40722e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009d90 tx=0x7f5ab002a780 comp rx=0 tx=0).stop 2024-04-25T13:17:19.940 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 -- 172.21.15.155:0/1309978635 shutdown_connections 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/1309978635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40b2c70 0x7f5ab40722e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 -- 172.21.15.155:0/1309978635 >> 172.21.15.155:0/1309978635 conn(0x7f5ab40c9a70 msgr2=0x7f5ab40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 -- 172.21.15.155:0/1309978635 shutdown_connections 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.936+0000 7f5abb3bf640 1 -- 172.21.15.155:0/1309978635 wait complete. 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.937+0000 7f5abb3bf640 1 Processor -- start 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.937+0000 7f5abb3bf640 1 -- start start 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5abb3bf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ab4074370 0x7f5ab40c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.941 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5abb3bf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 0x7f5ab41f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5abb3bf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40c9220 0x7f5ab41f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5abb3bf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40c8250 con 0x7f5ab40b2c70 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5abb3bf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40b3050 con 0x7f5ab40c9220 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5abb3bf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab40c83d0 con 0x7f5ab4074370 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 0x7f5ab41f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 0x7f5ab41f01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45990/0 (socket says 172.21.15.155:45990) 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 -- 172.21.15.155:0/2947163389 learned_addr learned my addr 172.21.15.155:0/2947163389 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:19.942 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 -- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ab4074370 msgr2=0x7f5ab40c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ab4074370 0x7f5ab40c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 -- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40c9220 msgr2=0x7f5ab41f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab995c640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40c9220 0x7f5ab41f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40c9220 0x7f5ab41f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.938+0000 7f5ab895a640 1 -- 172.21.15.155:0/2947163389 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab415ac20 con 0x7f5ab40b2c70 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5ab995c640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40c9220 0x7f5ab41f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5ab895a640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 0x7f5ab41f01d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c500 tx=0x7f5aa400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4017070 con 0x7f5ab40b2c70 2024-04-25T13:17:19.943 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa4005ce0 con 0x7f5ab40b2c70 2024-04-25T13:17:19.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab4150960 con 0x7f5ab40b2c70 2024-04-25T13:17:19.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4007330 con 0x7f5ab40b2c70 2024-04-25T13:17:19.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.939+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab41ef020 con 0x7f5ab40b2c70 2024-04-25T13:17:19.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.940+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab40c7970 con 0x7f5ab40b2c70 2024-04-25T13:17:19.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.940+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5aa401a070 con 0x7f5ab40b2c70 2024-04-25T13:17:19.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.941+0000 7f5aa9ffb640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a9806c8f0 0x7f5a9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:19.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.941+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5aa408b340 con 0x7f5ab40b2c70 2024-04-25T13:17:19.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.941+0000 7f5ab915b640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a9806c8f0 0x7f5a9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:19.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.941+0000 7f5ab915b640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a9806c8f0 0x7f5a9806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0034000 tx=0x7f5ab002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:19.945 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:19.945+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ab40c7970 con 0x7f5ab40b2c70 2024-04-25T13:17:20.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.128+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ab4068e40 con 0x7f5ab40b2c70 2024-04-25T13:17:20.129 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.129+0000 7f5aa9ffb640 1 -- 172.21.15.155:0/2947163389 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7f5aa40594c0 con 0x7f5ab40b2c70 2024-04-25T13:17:20.129 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:20.129 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a9806c8f0 msgr2=0x7f5a9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a9806c8f0 0x7f5a9806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0034000 tx=0x7f5ab002c000 comp rx=0 tx=0).stop 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 msgr2=0x7f5ab41f01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 0x7f5ab41f01d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c500 tx=0x7f5aa400c9c0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 shutdown_connections 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab40c9220 0x7f5ab41f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ab40b2c70 0x7f5ab41f01d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f5a9806c8f0 0x7f5a9806edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.132 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 --2- 172.21.15.155:0/2947163389 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f5ab4074370 0x7f5ab40c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.131+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 >> 172.21.15.155:0/2947163389 conn(0x7f5ab40c9a70 msgr2=0x7f5ab40cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.132+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 shutdown_connections 2024-04-25T13:17:20.133 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.132+0000 7f5abb3bf640 1 -- 172.21.15.155:0/2947163389 wait complete. 2024-04-25T13:17:20.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:19.529860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:19.949095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:23.675819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:20.144 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:20.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.243+0000 7f30a2431640 1 Processor -- start 2024-04-25T13:17:20.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.243+0000 7f30a2431640 1 -- start start 2024-04-25T13:17:20.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a2431640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f309c152f30 0x7f309c159730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a2431640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f309c06ed60 0x7f309c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a2431640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c159c70 0x7f309c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a2431640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f309c073930 con 0x7f309c06ed60 2024-04-25T13:17:20.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a2431640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f309c1592a0 con 0x7f309c152f30 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a2431640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f309c158f50 con 0x7f309c159c70 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f309b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f309c06ed60 0x7f309c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f309b7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f309c06ed60 0x7f309c0c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:45998/0 (socket says 172.21.15.155:45998) 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f309b7fe640 1 -- 172.21.15.155:0/91649097 learned_addr learned my addr 172.21.15.155:0/91649097 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f30a09ce640 1 --2- 172.21.15.155:0/91649097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c159c70 0x7f309c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.244+0000 7f309bfff640 1 --2- 172.21.15.155:0/91649097 >> v2:172.21.15.191:3300/0 conn(0x7f309c152f30 0x7f309c159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309b7fe640 1 -- 172.21.15.155:0/91649097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c159c70 msgr2=0x7f309c0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309b7fe640 1 --2- 172.21.15.155:0/91649097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c159c70 0x7f309c0c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309b7fe640 1 -- 172.21.15.155:0/91649097 >> v2:172.21.15.191:3300/0 conn(0x7f309c152f30 msgr2=0x7f309c159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309b7fe640 1 --2- 172.21.15.155:0/91649097 >> v2:172.21.15.191:3300/0 conn(0x7f309c152f30 0x7f309c159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309b7fe640 1 -- 172.21.15.155:0/91649097 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c073b60 con 0x7f309c06ed60 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309b7fe640 1 --2- 172.21.15.155:0/91649097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c06ed60 0x7f309c0c9a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f309c070240 tx=0x7f309002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41897b9c4bffd8ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309affd640 1 -- 172.21.15.155:0/91649097 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090037070 con 0x7f309c06ed60 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309affd640 1 -- 172.21.15.155:0/91649097 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3090032440 con 0x7f309c06ed60 2024-04-25T13:17:20.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.245+0000 7f309affd640 1 -- 172.21.15.155:0/91649097 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090032810 con 0x7f309c06ed60 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 -- 172.21.15.155:0/91649097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c06ed60 msgr2=0x7f309c0c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 --2- 172.21.15.155:0/91649097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c06ed60 0x7f309c0c9a00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f309c070240 tx=0x7f309002a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 -- 172.21.15.155:0/91649097 shutdown_connections 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 --2- 172.21.15.155:0/91649097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c159c70 0x7f309c0c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 --2- 172.21.15.155:0/91649097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c06ed60 0x7f309c0c9a00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 --2- 172.21.15.155:0/91649097 >> v2:172.21.15.191:3300/0 conn(0x7f309c152f30 0x7f309c159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 -- 172.21.15.155:0/91649097 >> 172.21.15.155:0/91649097 conn(0x7f309c06f5f0 msgr2=0x7f309c06f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 -- 172.21.15.155:0/91649097 shutdown_connections 2024-04-25T13:17:20.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.246+0000 7f30a2431640 1 -- 172.21.15.155:0/91649097 wait complete. 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.247+0000 7f30a2431640 1 Processor -- start 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.247+0000 7f30a2431640 1 -- start start 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a2431640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c152f30 0x7f309c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a2431640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 0x7f309c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a2431640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f309c0c2ac0 0x7f309c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a2431640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f309c074400 con 0x7f309c159c70 2024-04-25T13:17:20.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a2431640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f309c074120 con 0x7f309c0c2ac0 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a2431640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f309c0c8970 con 0x7f309c152f30 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 0x7f309c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 0x7f309c148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46010/0 (socket says 172.21.15.155:46010) 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 -- 172.21.15.155:0/4201247276 learned_addr learned my addr 172.21.15.155:0/4201247276 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309bfff640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c152f30 0x7f309c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f30a09ce640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f309c0c2ac0 0x7f309c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 -- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c152f30 msgr2=0x7f309c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c152f30 0x7f309c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 -- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f309c0c2ac0 msgr2=0x7f309c148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f309c0c2ac0 0x7f309c148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.248+0000 7f309b7fe640 1 -- 172.21.15.155:0/4201247276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c1f49e0 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.249+0000 7f309b7fe640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 0x7f309c148840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3090000c00 tx=0x7f30900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.249+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090041020 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.249+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309003d620 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.249+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c1f4cc0 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.249+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090037040 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.249+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c1f5280 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.250+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c0c92b0 con 0x7f309c159c70 2024-04-25T13:17:20.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.250+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3090044020 con 0x7f309c159c70 2024-04-25T13:17:20.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.251+0000 7f3098ff9640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f308806c920 0x7f308806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.251+0000 7f309bfff640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f308806c920 0x7f308806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.251+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f30900ac450 con 0x7f309c159c70 2024-04-25T13:17:20.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.251+0000 7f309bfff640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f308806c920 0x7f308806ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f308c009b40 tx=0x7f308c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.255+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f309c0c92b0 con 0x7f309c159c70 2024-04-25T13:17:20.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.428+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f309c068f50 con 0x7f309c159c70 2024-04-25T13:17:20.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.428+0000 7f3098ff9640 1 -- 172.21.15.155:0/4201247276 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f309004b030 con 0x7f309c159c70 2024-04-25T13:17:20.429 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f308806c920 msgr2=0x7f308806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f308806c920 0x7f308806ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f308c009b40 tx=0x7f308c009190 comp rx=0 tx=0).stop 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 msgr2=0x7f309c148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 0x7f309c148840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3090000c00 tx=0x7f30900046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 shutdown_connections 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f309c0c2ac0 0x7f309c148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f309c159c70 0x7f309c148840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f308806c920 0x7f308806ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 --2- 172.21.15.155:0/4201247276 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f309c152f30 0x7f309c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.430+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 >> 172.21.15.155:0/4201247276 conn(0x7f309c06f5f0 msgr2=0x7f309c152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.431+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 shutdown_connections 2024-04-25T13:17:20.432 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.431+0000 7f30a2431640 1 -- 172.21.15.155:0/4201247276 wait complete. 2024-04-25T13:17:20.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:20.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.542+0000 7fab4e04e640 1 Processor -- start 2024-04-25T13:17:20.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.542+0000 7fab4e04e640 1 -- start start 2024-04-25T13:17:20.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab4e04e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab48155260 0x7fab480cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab4e04e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab4e04e640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab480ce850 con 0x7fab480740b0 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab4e04e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fab4815b160 con 0x7fab48155260 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab4e04e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fab480ceb10 con 0x7fab4815bd00 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab48155260 0x7fab480cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fab48155260 0x7fab480cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46016/0 (socket says 172.21.15.155:46016) 2024-04-25T13:17:20.544 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 -- 172.21.15.155:0/898574110 learned_addr learned my addr 172.21.15.155:0/898574110 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:20.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab47fff640 1 --2- 172.21.15.155:0/898574110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 -- 172.21.15.155:0/898574110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 msgr2=0x7fab4815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 --2- 172.21.15.155:0/898574110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 -- 172.21.15.155:0/898574110 >> v1:172.21.15.191:6789/0 conn(0x7fab480740b0 legacy=0x7fab4815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.543+0000 7fab477fe640 1 -- 172.21.15.155:0/898574110 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab480cedf0 con 0x7fab48155260 2024-04-25T13:17:20.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.544+0000 7fab477fe640 1 --2- 172.21.15.155:0/898574110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab48155260 0x7fab480cad90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab38009870 tx=0x7fab3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeecb0362e99523a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.544+0000 7fab467fc640 1 -- 172.21.15.155:0/898574110 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38037070 con 0x7fab48155260 2024-04-25T13:17:20.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.544+0000 7fab467fc640 1 -- 172.21.15.155:0/898574110 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38032440 con 0x7fab48155260 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.544+0000 7fab467fc640 1 -- 172.21.15.155:0/898574110 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38032810 con 0x7fab48155260 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 -- 172.21.15.155:0/898574110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab48155260 msgr2=0x7fab480cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 --2- 172.21.15.155:0/898574110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab48155260 0x7fab480cad90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab38009870 tx=0x7fab3802a270 comp rx=0 tx=0).stop 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 -- 172.21.15.155:0/898574110 shutdown_connections 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 --2- 172.21.15.155:0/898574110 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 --2- 172.21.15.155:0/898574110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab48155260 0x7fab480cad90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 -- 172.21.15.155:0/898574110 >> 172.21.15.155:0/898574110 conn(0x7fab48073590 msgr2=0x7fab480739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 -- 172.21.15.155:0/898574110 shutdown_connections 2024-04-25T13:17:20.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.545+0000 7fab4e04e640 1 -- 172.21.15.155:0/898574110 wait complete. 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.546+0000 7fab4e04e640 1 Processor -- start 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.546+0000 7fab4e04e640 1 -- start start 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 0x7fab48157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab48155260 0x7fab48155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab48155640 con 0x7fab480740b0 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fab480cf3b0 con 0x7fab48155260 2024-04-25T13:17:20.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fab481557c0 con 0x7fab4815bd00 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 0x7fab48157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 0x7fab48157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46030/0 (socket says 172.21.15.155:46030) 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 -- 172.21.15.155:0/3416660852 learned_addr learned my addr 172.21.15.155:0/3416660852 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab46ffd640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab48155260 0x7fab48155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab47fff640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 -- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 msgr2=0x7fab4815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 -- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab48155260 msgr2=0x7fab48155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab48155260 0x7fab48155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 -- 172.21.15.155:0/3416660852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab481f1350 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab477fe640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 0x7fab48157fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab3802a2b0 tx=0x7fab380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38037040 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38042070 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab480c66e0 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab38030860 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.547+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab481f15d0 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.548+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab48068e40 con 0x7fab480740b0 2024-04-25T13:17:20.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.549+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab38030a00 con 0x7fab480740b0 2024-04-25T13:17:20.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.549+0000 7fab2ffff640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fab3406c8f0 0x7fab3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.549+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fab380ac8c0 con 0x7fab480740b0 2024-04-25T13:17:20.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.549+0000 7fab46ffd640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fab3406c8f0 0x7fab3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.550+0000 7fab46ffd640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fab3406c8f0 0x7fab3406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007fd0 tx=0x7fab3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.553+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab481f1350 con 0x7fab480740b0 2024-04-25T13:17:20.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.726+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fab480ce220 con 0x7fab480740b0 2024-04-25T13:17:20.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.726+0000 7fab2ffff640 1 -- 172.21.15.155:0/3416660852 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fab38045360 con 0x7fab480740b0 2024-04-25T13:17:20.727 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.728+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fab3406c8f0 msgr2=0x7fab3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.728+0000 7fab4e04e640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fab3406c8f0 0x7fab3406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab3c007fd0 tx=0x7fab3c009040 comp rx=0 tx=0).stop 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.728+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 msgr2=0x7fab48157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.728+0000 7fab4e04e640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 0x7fab48157fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fab3802a2b0 tx=0x7fab380046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 shutdown_connections 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fab3406c8f0 0x7fab3406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fab4815bd00 0x7fab4815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fab48155260 0x7fab48155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 --2- 172.21.15.155:0/3416660852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab480740b0 0x7fab48157fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 >> 172.21.15.155:0/3416660852 conn(0x7fab48073590 msgr2=0x7fab480cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 shutdown_connections 2024-04-25T13:17:20.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.729+0000 7fab4e04e640 1 -- 172.21.15.155:0/3416660852 wait complete. 2024-04-25T13:17:20.739 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:20.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.840+0000 7f67b9e05640 1 Processor -- start 2024-04-25T13:17:20.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.840+0000 7f67b9e05640 1 -- start start 2024-04-25T13:17:20.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b9e05640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f67b4071f00 0x7f67b4158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b9e05640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67b40c8960 0x7f67b40c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b9e05640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b40cd4e0 con 0x7f67b40c5c50 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b9e05640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f67b41585c0 con 0x7f67b40c8960 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b9e05640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f67b4151dc0 con 0x7f67b4071f00 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67b40c8960 0x7f67b40c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67b40c8960 0x7f67b40c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46046/0 (socket says 172.21.15.155:46046) 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 -- 172.21.15.155:0/1039220208 learned_addr learned my addr 172.21.15.155:0/1039220208 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b2ffd640 1 --2- 172.21.15.155:0/1039220208 >> v2:172.21.15.191:3300/0 conn(0x7f67b4071f00 0x7f67b4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 -- 172.21.15.155:0/1039220208 >> v2:172.21.15.191:3300/0 conn(0x7f67b4071f00 msgr2=0x7f67b4158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 --2- 172.21.15.155:0/1039220208 >> v2:172.21.15.191:3300/0 conn(0x7f67b4071f00 0x7f67b4158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 -- 172.21.15.155:0/1039220208 >> v1:172.21.15.191:6789/0 conn(0x7f67b40c5c50 legacy=0x7f67b4072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.841+0000 7f67b3fff640 1 -- 172.21.15.155:0/1039220208 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b40c65c0 con 0x7f67b40c8960 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.842+0000 7f67b3fff640 1 --2- 172.21.15.155:0/1039220208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b40c8960 0x7f67b40c9050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f67b40689a0 tx=0x7f67ac02c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc6f5bbf744f9bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.842+0000 7f67b27fc640 1 -- 172.21.15.155:0/1039220208 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac03a070 con 0x7f67b40c8960 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.842+0000 7f67b27fc640 1 -- 172.21.15.155:0/1039220208 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ac032480 con 0x7f67b40c8960 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.842+0000 7f67b27fc640 1 -- 172.21.15.155:0/1039220208 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac032850 con 0x7f67b40c8960 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 -- 172.21.15.155:0/1039220208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b40c8960 msgr2=0x7f67b40c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 --2- 172.21.15.155:0/1039220208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b40c8960 0x7f67b40c9050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f67b40689a0 tx=0x7f67ac02c6b0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 -- 172.21.15.155:0/1039220208 shutdown_connections 2024-04-25T13:17:20.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 --2- 172.21.15.155:0/1039220208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b40c8960 0x7f67b40c9050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 --2- 172.21.15.155:0/1039220208 >> v2:172.21.15.191:3300/0 conn(0x7f67b4071f00 0x7f67b4158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 -- 172.21.15.155:0/1039220208 >> 172.21.15.155:0/1039220208 conn(0x7f67b406d660 msgr2=0x7f67b4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:20.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 -- 172.21.15.155:0/1039220208 shutdown_connections 2024-04-25T13:17:20.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.843+0000 7f67b9e05640 1 -- 172.21.15.155:0/1039220208 wait complete. 2024-04-25T13:17:20.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.844+0000 7f67b9e05640 1 Processor -- start 2024-04-25T13:17:20.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.844+0000 7f67b9e05640 1 -- start start 2024-04-25T13:17:20.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 0x7f67b4156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b40c5c50 0x7f67b41e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67b40c8960 0x7f67b41ee020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67b4071420 con 0x7f67b4071f00 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f67b40711d0 con 0x7f67b40c5c50 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f67b4071700 con 0x7f67b40c8960 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 0x7f67b4156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 0x7f67b4156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46054/0 (socket says 172.21.15.155:46054) 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 -- 172.21.15.155:0/2606025975 learned_addr learned my addr 172.21.15.155:0/2606025975 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b2ffd640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b40c5c50 0x7f67b41e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b3fff640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67b40c8960 0x7f67b41ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 -- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67b40c8960 msgr2=0x7f67b41ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67b40c8960 0x7f67b41ee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 -- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b40c5c50 msgr2=0x7f67b41e6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b40c5c50 0x7f67b41e6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 -- 172.21.15.155:0/2606025975 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b41560d0 con 0x7f67b4071f00 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b37fe640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 0x7f67b4156890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c460 tx=0x7f67a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4016020 con 0x7f67b4071f00 2024-04-25T13:17:20.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a4012870 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b41541e0 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4012c60 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.845+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b41547a0 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.846+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b4068f50 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.847+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f67a4019020 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.847+0000 7f67abfff640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.847+0000 7f67b2ffd640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.847+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f67a408b9d0 con 0x7f67b4071f00 2024-04-25T13:17:20.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.848+0000 7f67b2ffd640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f679406c8f0 0x7f679406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67b41f1240 tx=0x7f679c003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:20.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:20.852+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f67a4020070 con 0x7f67b4071f00 2024-04-25T13:17:21.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.031+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f67b40cd2c0 con 0x7f67b4071f00 2024-04-25T13:17:21.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.031+0000 7f67abfff640 1 -- 172.21.15.155:0/2606025975 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f67a4059a00 con 0x7f67b4071f00 2024-04-25T13:17:21.032 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f679406c8f0 msgr2=0x7f679406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f679406c8f0 0x7f679406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67b41f1240 tx=0x7f679c003990 comp rx=0 tx=0).stop 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 msgr2=0x7f67b4156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 0x7f67b4156890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f67a400c460 tx=0x7f67a400c920 comp rx=0 tx=0).stop 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 shutdown_connections 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f679406c8f0 0x7f679406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f67b40c8960 0x7f67b41ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67b40c5c50 0x7f67b41e6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 --2- 172.21.15.155:0/2606025975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67b4071f00 0x7f67b4156890 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 >> 172.21.15.155:0/2606025975 conn(0x7f67b406d660 msgr2=0x7f67b40cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 shutdown_connections 2024-04-25T13:17:21.035 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.033+0000 7f67b9e05640 1 -- 172.21.15.155:0/2606025975 wait complete. 2024-04-25T13:17:21.044 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:21.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.144+0000 7f03d5f44640 1 Processor -- start 2024-04-25T13:17:21.144 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.144+0000 7f03d5f44640 1 -- start start 2024-04-25T13:17:21.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03d5f44640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f03d0155260 0x7f03d00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03d5f44640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03d00740b0 0x7f03d015b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03d5f44640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d00c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03d5f44640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f03d015b160 con 0x7f03d00740b0 2024-04-25T13:17:21.146 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03d5f44640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f03d015bfc0 con 0x7f03d0155260 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03d5f44640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f03d00ce850 con 0x7f03d015bb30 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03d00740b0 0x7f03d015b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03d00740b0 0x7f03d015b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46058/0 (socket says 172.21.15.155:46058) 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 -- 172.21.15.155:0/966627415 learned_addr learned my addr 172.21.15.155:0/966627415 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03cf7fe640 1 --2- 172.21.15.155:0/966627415 >> v2:172.21.15.191:3300/0 conn(0x7f03d0155260 0x7f03d00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03cffff640 1 --2- 172.21.15.155:0/966627415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d00c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 -- 172.21.15.155:0/966627415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 msgr2=0x7f03d00c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 --2- 172.21.15.155:0/966627415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d00c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 -- 172.21.15.155:0/966627415 >> v2:172.21.15.191:3300/0 conn(0x7f03d0155260 msgr2=0x7f03d00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 --2- 172.21.15.155:0/966627415 >> v2:172.21.15.191:3300/0 conn(0x7f03d0155260 0x7f03d00cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.145+0000 7f03ceffd640 1 -- 172.21.15.155:0/966627415 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d00ceb10 con 0x7f03d00740b0 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.146+0000 7f03ceffd640 1 --2- 172.21.15.155:0/966627415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d015b5f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f03d00704a0 tx=0x7f03c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a40ae45f01df9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.146+0000 7f03ce7fc640 1 -- 172.21.15.155:0/966627415 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4037070 con 0x7f03d00740b0 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.146+0000 7f03ce7fc640 1 -- 172.21.15.155:0/966627415 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c4032440 con 0x7f03d00740b0 2024-04-25T13:17:21.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.146+0000 7f03ce7fc640 1 -- 172.21.15.155:0/966627415 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4032810 con 0x7f03d00740b0 2024-04-25T13:17:21.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 -- 172.21.15.155:0/966627415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 msgr2=0x7f03d015b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 --2- 172.21.15.155:0/966627415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d015b5f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f03d00704a0 tx=0x7f03c402a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 -- 172.21.15.155:0/966627415 shutdown_connections 2024-04-25T13:17:21.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 --2- 172.21.15.155:0/966627415 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d00c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 --2- 172.21.15.155:0/966627415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d015b5f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 --2- 172.21.15.155:0/966627415 >> v2:172.21.15.191:3300/0 conn(0x7f03d0155260 0x7f03d00cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 -- 172.21.15.155:0/966627415 >> 172.21.15.155:0/966627415 conn(0x7f03d0073590 msgr2=0x7f03d00739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 -- 172.21.15.155:0/966627415 shutdown_connections 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.147+0000 7f03d5f44640 1 -- 172.21.15.155:0/966627415 wait complete. 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.148+0000 7f03d5f44640 1 Processor -- start 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.148+0000 7f03d5f44640 1 -- start start 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03d5f44640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d0148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03d5f44640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03d0155260 0x7f03d015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03d5f44640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03d5f44640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f03d00cf3b0 con 0x7f03d00740b0 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03d5f44640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f03d00cf0d0 con 0x7f03d0155260 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03d5f44640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f03d0155640 con 0x7f03d015bb30 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d0148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d0148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46064/0 (socket says 172.21.15.155:46064) 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 -- 172.21.15.155:0/1236092628 learned_addr learned my addr 172.21.15.155:0/1236092628 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03ceffd640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03d0155260 0x7f03d015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.153 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cffff640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 -- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 msgr2=0x7f03d014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 -- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03d0155260 msgr2=0x7f03d015d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03d0155260 0x7f03d015d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 -- 172.21.15.155:0/1236092628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d014c5b0 con 0x7f03d00740b0 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.149+0000 7f03cf7fe640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d0148050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e890 tx=0x7f03c000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.150+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0017070 con 0x7f03d00740b0 2024-04-25T13:17:21.154 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.150+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c000c940 con 0x7f03d00740b0 2024-04-25T13:17:21.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.150+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d014c870 con 0x7f03d00740b0 2024-04-25T13:17:21.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.150+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c000cd10 con 0x7f03d00740b0 2024-04-25T13:17:21.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.150+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d014ce30 con 0x7f03d00740b0 2024-04-25T13:17:21.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.150+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d0068e40 con 0x7f03d00740b0 2024-04-25T13:17:21.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.151+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03c001a070 con 0x7f03d00740b0 2024-04-25T13:17:21.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.151+0000 7f03b7fff640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f03bc06c8f0 0x7f03bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.152+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f03c008be90 con 0x7f03d00740b0 2024-04-25T13:17:21.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.152+0000 7f03ceffd640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f03bc06c8f0 0x7f03bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.152+0000 7f03ceffd640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f03bc06c8f0 0x7f03bc06edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.156+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03c00597e0 con 0x7f03d00740b0 2024-04-25T13:17:21.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.331+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f03d00ca680 con 0x7f03d00740b0 2024-04-25T13:17:21.332 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.332+0000 7f03b7fff640 1 -- 172.21.15.155:0/1236092628 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f03c005dae0 con 0x7f03d00740b0 2024-04-25T13:17:21.332 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:21.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f03bc06c8f0 msgr2=0x7f03bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f03bc06c8f0 0x7f03bc06edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f03c4034000 tx=0x7f03c402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:21.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 msgr2=0x7f03d0148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d0148050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e890 tx=0x7f03c000ed50 comp rx=0 tx=0).stop 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 shutdown_connections 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f03bc06c8f0 0x7f03bc06edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f03d015bb30 0x7f03d014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f03d0155260 0x7f03d015d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 --2- 172.21.15.155:0/1236092628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03d00740b0 0x7f03d0148050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 >> 172.21.15.155:0/1236092628 conn(0x7f03d0073590 msgr2=0x7f03d0073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 shutdown_connections 2024-04-25T13:17:21.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.334+0000 7f03d5f44640 1 -- 172.21.15.155:0/1236092628 wait complete. 2024-04-25T13:17:21.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:17:21.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.443+0000 7efe783f9640 1 Processor -- start 2024-04-25T13:17:21.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.443+0000 7efe783f9640 1 -- start start 2024-04-25T13:17:21.444 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe783f9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe701553a0 0x7efe700c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe783f9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7015e990 con 0x7efe700c8990 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe783f9640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7015ec70 con 0x7efe7015bd80 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe783f9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efe70155780 con 0x7efe701553a0 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe76195640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe701553a0 0x7efe700c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe76195640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe701553a0 0x7efe700c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46080/0 (socket says 172.21.15.155:46080) 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe76195640 1 -- 172.21.15.155:0/656053060 learned_addr learned my addr 172.21.15.155:0/656053060 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:21.445 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe75994640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7efe700c8990 0x7efe7015b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55470/0 (socket says 172.21.15.155:55470) 2024-04-25T13:17:21.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe76195640 1 -- 172.21.15.155:0/656053060 >> v1:172.21.15.191:6789/0 conn(0x7efe7015bd80 legacy=0x7efe700c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe76195640 1 -- 172.21.15.155:0/656053060 >> v1:172.21.15.155:6789/0 conn(0x7efe700c8990 legacy=0x7efe7015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe76195640 1 -- 172.21.15.155:0/656053060 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7015ef50 con 0x7efe701553a0 2024-04-25T13:17:21.446 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.444+0000 7efe75193640 1 -- 172.21.15.155:0/656053060 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177695983 0 0) 0x7efe7015e990 con 0x7efe700c8990 2024-04-25T13:17:21.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.445+0000 7efe76195640 1 --2- 172.21.15.155:0/656053060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe701553a0 0x7efe700c8450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efe60009e50 tx=0x7efe6002a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714fac6c0644d7b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.447 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.445+0000 7efe75193640 1 -- 172.21.15.155:0/656053060 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60036070 con 0x7efe701553a0 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.445+0000 7efe75193640 1 -- 172.21.15.155:0/656053060 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60031600 con 0x7efe701553a0 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.445+0000 7efe75193640 1 -- 172.21.15.155:0/656053060 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe600319d0 con 0x7efe701553a0 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 -- 172.21.15.155:0/656053060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe701553a0 msgr2=0x7efe700c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 --2- 172.21.15.155:0/656053060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe701553a0 0x7efe700c8450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efe60009e50 tx=0x7efe6002a7f0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 -- 172.21.15.155:0/656053060 shutdown_connections 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 --2- 172.21.15.155:0/656053060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe701553a0 0x7efe700c8450 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 -- 172.21.15.155:0/656053060 >> 172.21.15.155:0/656053060 conn(0x7efe70074d50 msgr2=0x7efe70075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 -- 172.21.15.155:0/656053060 shutdown_connections 2024-04-25T13:17:21.448 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.446+0000 7efe783f9640 1 -- 172.21.15.155:0/656053060 wait complete. 2024-04-25T13:17:21.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.447+0000 7efe783f9640 1 Processor -- start 2024-04-25T13:17:21.449 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.447+0000 7efe783f9640 1 -- start start 2024-04-25T13:17:21.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe783f9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe700c8990 0x7efe70149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe783f9640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe701553a0 0x7efe700caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe783f9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 0x7efe700caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.451 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe783f9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe7015f510 con 0x7efe7015bd80 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe783f9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7efe700c4520 con 0x7efe700c8990 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe783f9640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7efe7015b150 con 0x7efe701553a0 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 0x7efe700caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 0x7efe700caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46084/0 (socket says 172.21.15.155:46084) 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 -- 172.21.15.155:0/2148151216 learned_addr learned my addr 172.21.15.155:0/2148151216 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76195640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe700c8990 0x7efe70149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe75994640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe701553a0 0x7efe700caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.452 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 -- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe701553a0 msgr2=0x7efe700caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe701553a0 0x7efe700caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 -- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe700c8990 msgr2=0x7efe70149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe700c8990 0x7efe70149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 -- 172.21.15.155:0/2148151216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70158dc0 con 0x7efe7015bd80 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe76996640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 0x7efe700caf60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efe6800b440 tx=0x7efe6800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.448+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68015020 con 0x7efe7015bd80 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.449+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe68011830 con 0x7efe7015bd80 2024-04-25T13:17:21.453 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.449+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68011c20 con 0x7efe7015bd80 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.449+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe701590a0 con 0x7efe7015bd80 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.449+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe700cd400 con 0x7efe7015bd80 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.450+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe70068e40 con 0x7efe7015bd80 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.450+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe68018020 con 0x7efe7015bd80 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.450+0000 7efe6effd640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7efe5c06c8f0 0x7efe5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.451+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efe6808b9a0 con 0x7efe7015bd80 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.451+0000 7efe76195640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7efe5c06c8f0 0x7efe5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.454 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.451+0000 7efe76195640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7efe5c06c8f0 0x7efe5c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe7006d3b0 tx=0x7efe60009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.455 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.455+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe6801f030 con 0x7efe7015bd80 2024-04-25T13:17:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.640+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efe7014f420 con 0x7efe7015bd80 2024-04-25T13:17:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.640+0000 7efe6effd640 1 -- 172.21.15.155:0/2148151216 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7efe68059380 con 0x7efe7015bd80 2024-04-25T13:17:21.640 INFO:teuthology.orchestra.run.smithi155.stderr:listed 0 entries 2024-04-25T13:17:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7efe5c06c8f0 msgr2=0x7efe5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.642 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7efe5c06c8f0 0x7efe5c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe7006d3b0 tx=0x7efe60009000 comp rx=0 tx=0).stop 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 msgr2=0x7efe700caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 0x7efe700caf60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efe6800b440 tx=0x7efe6800b900 comp rx=0 tx=0).stop 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 shutdown_connections 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe7015bd80 0x7efe700caf60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7efe5c06c8f0 0x7efe5c06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7efe701553a0 0x7efe700caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 --2- 172.21.15.155:0/2148151216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe700c8990 0x7efe70149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 >> 172.21.15.155:0/2148151216 conn(0x7efe70074d50 msgr2=0x7efe700c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.643 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 shutdown_connections 2024-04-25T13:17:21.644 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.642+0000 7efe783f9640 1 -- 172.21.15.155:0/2148151216 wait complete. 2024-04-25T13:17:21.653 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-04-25T13:17:21.653 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:17:21.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.806+0000 7f21cfae1640 1 Processor -- start 2024-04-25T13:17:21.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.806+0000 7f21cfae1640 1 -- start start 2024-04-25T13:17:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cfae1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cfae1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f21c8075850 0x7f21c8074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cfae1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c80cd830 con 0x7f21c815f2a0 2024-04-25T13:17:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cfae1640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f21c815ee10 con 0x7f21c8075850 2024-04-25T13:17:21.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cfae1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f21c81446e0 con 0x7f21c8144300 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cd07c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f21c815f2a0 0x7f21c815b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55476/0 (socket says 172.21.15.155:55476) 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cd07c640 1 -- 172.21.15.155:0/1886314028 learned_addr learned my addr 172.21.15.155:0/1886314028 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21ce07e640 1 --2- 172.21.15.155:0/1886314028 >> v2:172.21.15.191:3300/0 conn(0x7f21c8075850 0x7f21c8074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cd87d640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.807+0000 7f21cc87b640 1 -- 172.21.15.155:0/1886314028 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355369274 0 0) 0x7f21c80cd830 con 0x7f21c815f2a0 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21cc87b640 1 -- 172.21.15.155:0/1886314028 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21b4003520 con 0x7f21c815f2a0 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21ce07e640 1 -- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 msgr2=0x7f21c80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21cc87b640 1 -- 172.21.15.155:0/1886314028 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 564263835 0 0) 0x7f21b4003520 con 0x7f21c815f2a0 2024-04-25T13:17:21.809 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21ce07e640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c80c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21ce07e640 1 -- 172.21.15.155:0/1886314028 >> v1:172.21.15.155:6789/0 conn(0x7f21c815f2a0 legacy=0x7f21c815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21ce07e640 1 -- 172.21.15.155:0/1886314028 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c80c93b0 con 0x7f21c8075850 2024-04-25T13:17:21.810 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21cd87d640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.808+0000 7f21ce07e640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c8074d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009d90 tx=0x7f21c002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aecd41038f9c5601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cc87b640 1 -- 172.21.15.155:0/1886314028 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8001670 con 0x7f21c8075850 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cc87b640 1 -- 172.21.15.155:0/1886314028 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c0007540 con 0x7f21c8075850 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cc87b640 1 -- 172.21.15.155:0/1886314028 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0007910 con 0x7f21c8075850 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 -- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 msgr2=0x7f21c8074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c8074d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009d90 tx=0x7f21c002a680 comp rx=0 tx=0).stop 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 -- 172.21.15.155:0/1886314028 shutdown_connections 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c8074d50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1886314028 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 -- 172.21.15.155:0/1886314028 >> 172.21.15.155:0/1886314028 conn(0x7f21c806b920 msgr2=0x7f21c806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 -- 172.21.15.155:0/1886314028 shutdown_connections 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.809+0000 7f21cfae1640 1 -- 172.21.15.155:0/1886314028 wait complete. 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.810+0000 7f21cfae1640 1 Processor -- start 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.810+0000 7f21cfae1640 1 -- start start 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cfae1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c80c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cfae1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c81f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cfae1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 0x7f21c813ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cfae1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21c815e7c0 con 0x7f21c815f2a0 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cfae1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f21c815bda0 con 0x7f21c8075850 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cfae1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f21c815eaa0 con 0x7f21c8144300 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 0x7f21c813ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 0x7f21c813ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46088/0 (socket says 172.21.15.155:46088) 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 -- 172.21.15.155:0/1237578486 learned_addr learned my addr 172.21.15.155:0/1237578486 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cd87d640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c80c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.816 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cd07c640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c81f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 -- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 msgr2=0x7f21c81f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c81f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 -- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 msgr2=0x7f21c80c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c80c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21ce07e640 1 -- 172.21.15.155:0/1237578486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c815d6e0 con 0x7f21c815f2a0 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.811+0000 7f21cd07c640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c81f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.812+0000 7f21ce07e640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 0x7f21c813ec80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009eb0 tx=0x7f21c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.817 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.812+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c003f070 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.812+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c0031b40 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.812+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c81f4ad0 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.812+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0007e90 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.812+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c81f0bc0 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.813+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c81f0dc0 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.813+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21c003b410 con 0x7f21c815f2a0 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.814+0000 7f21be7fc640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f21ac06c8f0 0x7f21ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:21.818 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.814+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f21c00ad150 con 0x7f21c815f2a0 2024-04-25T13:17:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.814+0000 7f21cd87d640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f21ac06c8f0 0x7f21ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.814+0000 7f21cd87d640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f21ac06c8f0 0x7f21ac06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009560 tx=0x7f21c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:21.819 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.818+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21c81f0dc0 con 0x7f21c815f2a0 2024-04-25T13:17:21.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.997+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21c81f09b0 con 0x7f21c815f2a0 2024-04-25T13:17:21.998 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:21.998+0000 7f21be7fc640 1 -- 172.21.15.155:0/1237578486 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7f21c007b210 con 0x7f21c815f2a0 2024-04-25T13:17:21.998 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:21.999 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:22.000 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f21ac06c8f0 msgr2=0x7f21ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f21ac06c8f0 0x7f21ac06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009560 tx=0x7f21c4009190 comp rx=0 tx=0).stop 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 msgr2=0x7f21c813ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 0x7f21c813ec80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009eb0 tx=0x7f21c0004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 shutdown_connections 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c815f2a0 0x7f21c813ec80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f21ac06c8f0 0x7f21ac06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f21c8144300 0x7f21c81f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.001 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 --2- 172.21.15.155:0/1237578486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f21c8075850 0x7f21c80c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 >> 172.21.15.155:0/1237578486 conn(0x7f21c806b920 msgr2=0x7f21c806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 shutdown_connections 2024-04-25T13:17:22.002 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.000+0000 7f21cfae1640 1 -- 172.21.15.155:0/1237578486 wait complete. 2024-04-25T13:17:22.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:16:09.629756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:16:19.529860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:16:19.949095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T13:16:23.675819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T13:17:22.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:17:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.112+0000 7f4c12ce8640 1 Processor -- start 2024-04-25T13:17:22.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.112+0000 7f4c12ce8640 1 -- start start 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c12ce8640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4c0c0c8340 0x7f4c0c0723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c12ce8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 0x7f4c0c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c12ce8640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0c157d70 con 0x7f4c0c0c8720 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c12ce8640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4c0c158680 con 0x7f4c0c0c8340 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c12ce8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c15be10 con 0x7f4c0c158b10 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c11285640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4c0c0c8720 0x7f4c0c151b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:55492/0 (socket says 172.21.15.155:55492) 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c11285640 1 -- 172.21.15.155:0/273627870 learned_addr learned my addr 172.21.15.155:0/273627870 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:22.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c10a84640 1 --2- 172.21.15.155:0/273627870 >> v2:172.21.15.191:3300/0 conn(0x7f4c0c0c8340 0x7f4c0c0723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0bfff640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 0x7f4c0c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392068378 0 0) 0x7f4c0c157d70 con 0x7f4c0c0c8720 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc003520 con 0x7f4c0c0c8720 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1428034028 0 0) 0x7f4bfc003520 con 0x7f4c0c0c8720 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 msgr2=0x7f4c0c15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 0x7f4c0c15b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 >> v2:172.21.15.191:3300/0 conn(0x7f4c0c0c8340 msgr2=0x7f4c0c0723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 --2- 172.21.15.155:0/273627870 >> v2:172.21.15.191:3300/0 conn(0x7f4c0c0c8340 0x7f4c0c0723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c15c0f0 con 0x7f4c0c0c8720 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f4c040019f0 con 0x7f4c0c0c8720 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c10a84640 1 --2- 172.21.15.155:0/273627870 >> v2:172.21.15.191:3300/0 conn(0x7f4c0c0c8340 0x7f4c0c0723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 >> v1:172.21.15.155:6789/0 conn(0x7f4c0c0c8720 legacy=0x7f4c0c151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 0x7f4bfc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.113+0000 7f4c0b7fe640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bfc003f30 0x7f4bfc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c0b7fe640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bfc004d40 0x7f4bfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c158680 con 0x7f4bfc004d40 2024-04-25T13:17:22.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c15be10 con 0x7f4bfc003f30 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc00b9c0 con 0x7f4c0c158b10 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c11285640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bfc004d40 0x7f4bfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c10a84640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 0x7f4bfc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c0bfff640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bfc003f30 0x7f4bfc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c11285640 1 -- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 msgr2=0x7f4bfc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c11285640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c158b10 0x7f4bfc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c11285640 1 -- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bfc003f30 msgr2=0x7f4bfc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c11285640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bfc003f30 0x7f4bfc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.114+0000 7f4c11285640 1 -- 172.21.15.155:0/273627870 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc003520 con 0x7f4bfc004d40 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c11285640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bfc004d40 0x7f4bfc0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0c8b30 tx=0x7f4bfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26037a32c4c3875 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0400a4c0 con 0x7f4bfc004d40 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c0402f070 con 0x7f4bfc004d40 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c0b7fe640 1 -- 172.21.15.155:0/273627870 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0402bca0 con 0x7f4bfc004d40 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c12ce8640 1 -- 172.21.15.155:0/273627870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bfc004d40 msgr2=0x7f4bfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/273627870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bfc004d40 0x7f4bfc0051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0c8b30 tx=0x7f4bfc005830 comp rx=0 tx=0).stop 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c11285640 1 -- 172.21.15.155:0/273627870 reap_dead start 2024-04-25T13:17:22.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c12ce8640 1 -- 172.21.15.155:0/273627870 shutdown_connections 2024-04-25T13:17:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c12ce8640 1 -- 172.21.15.155:0/273627870 >> 172.21.15.155:0/273627870 conn(0x7f4c0c06d660 msgr2=0x7f4c0c074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c12ce8640 1 -- 172.21.15.155:0/273627870 shutdown_connections 2024-04-25T13:17:22.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.115+0000 7f4c12ce8640 1 -- 172.21.15.155:0/273627870 wait complete. 2024-04-25T13:17:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.116+0000 7f4c12ce8640 1 Processor -- start 2024-04-25T13:17:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.116+0000 7f4c12ce8640 1 -- start start 2024-04-25T13:17:22.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c12ce8640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c0c0c54f0 0x7f4c0c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c12ce8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 0x7f4c0c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c12ce8640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c0c5e10 0x7f4c0c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c12ce8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c0728f0 con 0x7f4c0c158fa0 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c12ce8640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c158310 con 0x7f4c0c0c54f0 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c12ce8640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4c0c152220 con 0x7f4c0c0c5e10 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c0bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 0x7f4c0c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c0bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 0x7f4c0c0c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46114/0 (socket says 172.21.15.155:46114) 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c0bfff640 1 -- 172.21.15.155:0/3352720467 learned_addr learned my addr 172.21.15.155:0/3352720467 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:22.124 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.117+0000 7f4c10a84640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c0c0c54f0 0x7f4c0c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c11285640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c0c5e10 0x7f4c0c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c0bfff640 1 -- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c0c5e10 msgr2=0x7f4c0c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c0bfff640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c0c5e10 0x7f4c0c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c0bfff640 1 -- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c0c0c54f0 msgr2=0x7f4c0c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c0bfff640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c0c0c54f0 0x7f4c0c14ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c0bfff640 1 -- 172.21.15.155:0/3352720467 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0c14d190 con 0x7f4c0c158fa0 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c11285640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c0c5e10 0x7f4c0c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c0bfff640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 0x7f4c0c0c58d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80118e0 tx=0x7f4bf8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800faf0 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf800fc90 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c14d470 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8014440 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.118+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c159800 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.119+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c068f50 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.119+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bf8012040 con 0x7f4c0c158fa0 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.120+0000 7f4c097fa640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bf006c890 0x7f4bf006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.126 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.120+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4bf808c5b0 con 0x7f4c0c158fa0 2024-04-25T13:17:22.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.120+0000 7f4c10a84640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bf006c890 0x7f4bf006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.120+0000 7f4c10a84640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bf006c890 0x7f4bf006ed50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009dc0 tx=0x7f4c00009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.127 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.124+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4bf8019030 con 0x7f4c0c158fa0 2024-04-25T13:17:22.297 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.297+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4c0c069380 con 0x7f4c0c158fa0 2024-04-25T13:17:22.298 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.297+0000 7f4c097fa640 1 -- 172.21.15.155:0/3352720467 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4bf805a670 con 0x7f4c0c158fa0 2024-04-25T13:17:22.298 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 1 2024-04-25T13:17:22.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.299+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bf006c890 msgr2=0x7f4bf006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.299+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bf006c890 0x7f4bf006ed50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009dc0 tx=0x7f4c00009190 comp rx=0 tx=0).stop 2024-04-25T13:17:22.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.299+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 msgr2=0x7f4c0c0c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.300 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.299+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 0x7f4c0c0c58d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80118e0 tx=0x7f4bf8011da0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 shutdown_connections 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bf006c890 0x7f4bf006ed50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4c0c0c5e10 0x7f4c0c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c0c158fa0 0x7f4c0c0c58d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 --2- 172.21.15.155:0/3352720467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c0c0c54f0 0x7f4c0c14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 >> 172.21.15.155:0/3352720467 conn(0x7f4c0c06d660 msgr2=0x7f4c0c14e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 shutdown_connections 2024-04-25T13:17:22.301 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.300+0000 7f4c12ce8640 1 -- 172.21.15.155:0/3352720467 wait complete. 2024-04-25T13:17:22.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:17:22.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.412+0000 7f79c0242640 1 Processor -- start 2024-04-25T13:17:22.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.412+0000 7f79c0242640 1 -- start start 2024-04-25T13:17:22.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79c0242640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8074fc0 0x7f79b8072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79c0242640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79b80753a0 0x7f79b8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79c0242640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f79b8070980 0x7f79b8154c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79c0242640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f79b815b100 con 0x7f79b80753a0 2024-04-25T13:17:22.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79c0242640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f79b815b3c0 con 0x7f79b8070980 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79c0242640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f79b815b6a0 con 0x7f79b8074fc0 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79b80753a0 0x7f79b8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f79b80753a0 0x7f79b8070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46122/0 (socket says 172.21.15.155:46122) 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 -- 172.21.15.155:0/3071547311 learned_addr learned my addr 172.21.15.155:0/3071547311 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79be7df640 1 --2- 172.21.15.155:0/3071547311 >> v2:172.21.15.191:3300/0 conn(0x7f79b8070980 0x7f79b8154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bdfde640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8074fc0 0x7f79b8072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 -- 172.21.15.155:0/3071547311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8074fc0 msgr2=0x7f79b8072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8074fc0 0x7f79b8072e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 -- 172.21.15.155:0/3071547311 >> v2:172.21.15.191:3300/0 conn(0x7f79b8070980 msgr2=0x7f79b8154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 --2- 172.21.15.155:0/3071547311 >> v2:172.21.15.191:3300/0 conn(0x7f79b8070980 0x7f79b8154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bd7dd640 1 -- 172.21.15.155:0/3071547311 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b815b980 con 0x7f79b80753a0 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.413+0000 7f79bdfde640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8074fc0 0x7f79b8072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.414+0000 7f79bd7dd640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8070440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79b806f590 tx=0x7f79a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cdaaf7d9f20fa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.414+0000 7f79bcfdc640 1 -- 172.21.15.155:0/3071547311 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8037070 con 0x7f79b80753a0 2024-04-25T13:17:22.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.414+0000 7f79bcfdc640 1 -- 172.21.15.155:0/3071547311 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a8032440 con 0x7f79b80753a0 2024-04-25T13:17:22.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.414+0000 7f79bcfdc640 1 -- 172.21.15.155:0/3071547311 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8032810 con 0x7f79b80753a0 2024-04-25T13:17:22.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.414+0000 7f79c0242640 1 -- 172.21.15.155:0/3071547311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 msgr2=0x7f79b8070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.414+0000 7f79c0242640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8070440 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f79b806f590 tx=0x7f79a802a1e0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 -- 172.21.15.155:0/3071547311 shutdown_connections 2024-04-25T13:17:22.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 --2- 172.21.15.155:0/3071547311 >> v2:172.21.15.191:3300/0 conn(0x7f79b8070980 0x7f79b8154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8070440 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 --2- 172.21.15.155:0/3071547311 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8074fc0 0x7f79b8072e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 -- 172.21.15.155:0/3071547311 >> 172.21.15.155:0/3071547311 conn(0x7f79b806b920 msgr2=0x7f79b806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 -- 172.21.15.155:0/3071547311 shutdown_connections 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.415+0000 7f79c0242640 1 -- 172.21.15.155:0/3071547311 wait complete. 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 Processor -- start 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 -- start start 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8070980 0x7f79b81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b8074fc0 0x7f79b81539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79b8155300 con 0x7f79b80753a0 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f79b8155180 con 0x7f79b8074fc0 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.416+0000 7f79c0242640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f79b8155480 con 0x7f79b8070980 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:46134/0 (socket says 172.21.15.155:46134) 2024-04-25T13:17:22.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 -- 172.21.15.155:0/7528315 learned_addr learned my addr 172.21.15.155:0/7528315 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79bd7dd640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b8074fc0 0x7f79b81539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79bdfde640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8070980 0x7f79b81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 -- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8070980 msgr2=0x7f79b81559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8070980 0x7f79b81559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 -- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b8074fc0 msgr2=0x7f79b81539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b8074fc0 0x7f79b81539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 -- 172.21.15.155:0/7528315 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b81f0800 con 0x7f79b80753a0 2024-04-25T13:17:22.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79bdfde640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8070980 0x7f79b81559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79be7df640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8153f30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79b000ef00 tx=0x7f79b000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0018020 con 0x7f79b80753a0 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b000bd20 con 0x7f79b80753a0 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b8152870 con 0x7f79b80753a0 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0014640 con 0x7f79b80753a0 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.417+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b81f0d50 con 0x7f79b80753a0 2024-04-25T13:17:22.425 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.418+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b8068e40 con 0x7f79b80753a0 2024-04-25T13:17:22.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.419+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79b0005d10 con 0x7f79b80753a0 2024-04-25T13:17:22.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.419+0000 7f79ae7fc640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f799c06c8f0 0x7f799c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.419+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f79b008c530 con 0x7f79b80753a0 2024-04-25T13:17:22.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.419+0000 7f79bdfde640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f799c06c8f0 0x7f799c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.420+0000 7f79bdfde640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f799c06c8f0 0x7f799c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79b4006fd0 tx=0x7f79b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.426 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.423+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79b0022070 con 0x7f79b80753a0 2024-04-25T13:17:22.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.600+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79b814ebb0 con 0x7f79b80753a0 2024-04-25T13:17:22.600 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.600+0000 7f79ae7fc640 1 -- 172.21.15.155:0/7528315 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f79b005a4d0 con 0x7f79b80753a0 2024-04-25T13:17:22.601 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:22.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f799c06c8f0 msgr2=0x7f799c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f799c06c8f0 0x7f799c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79b4006fd0 tx=0x7f79b4008040 comp rx=0 tx=0).stop 2024-04-25T13:17:22.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 msgr2=0x7f79b8153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8153f30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f79b000ef00 tx=0x7f79b000b480 comp rx=0 tx=0).stop 2024-04-25T13:17:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 shutdown_connections 2024-04-25T13:17:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b80753a0 0x7f79b8153f30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f79b8074fc0 0x7f79b81539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.602+0000 7f79c0242640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f799c06c8f0 0x7f799c06edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.603+0000 7f79c0242640 1 --2- 172.21.15.155:0/7528315 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f79b8070980 0x7f79b81559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.605 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.603+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 >> 172.21.15.155:0/7528315 conn(0x7f79b806b920 msgr2=0x7f79b8159670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.603+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 shutdown_connections 2024-04-25T13:17:22.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.603+0000 7f79c0242640 1 -- 172.21.15.155:0/7528315 wait complete. 2024-04-25T13:17:22.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:17:22.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.714+0000 7f33c5f6f640 1 Processor -- start 2024-04-25T13:17:22.715 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.714+0000 7f33c5f6f640 1 -- start start 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33c5f6f640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f33c0152ef0 0x7f33c015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33c5f6f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33c015d040 0x7f33c006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33c5f6f640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c00c54b0 con 0x7f33c0158e50 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33c5f6f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f33c01532d0 con 0x7f33c015d040 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33c5f6f640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f33c0159300 con 0x7f33c0152ef0 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33c015d040 0x7f33c006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33c015d040 0x7f33c006ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58654/0 (socket says 172.21.15.155:58654) 2024-04-25T13:17:22.717 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 -- 172.21.15.155:0/3991423500 learned_addr learned my addr 172.21.15.155:0/3991423500 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bf7fe640 1 --2- 172.21.15.155:0/3991423500 >> v2:172.21.15.191:3300/0 conn(0x7f33c0152ef0 0x7f33c015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 -- 172.21.15.155:0/3991423500 >> v2:172.21.15.191:3300/0 conn(0x7f33c0152ef0 msgr2=0x7f33c015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 --2- 172.21.15.155:0/3991423500 >> v2:172.21.15.191:3300/0 conn(0x7f33c0152ef0 0x7f33c015cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 -- 172.21.15.155:0/3991423500 >> v1:172.21.15.191:6789/0 conn(0x7f33c0158e50 legacy=0x7f33c0074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bffff640 1 -- 172.21.15.155:0/3991423500 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c01595e0 con 0x7f33c015d040 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.715+0000 7f33bf7fe640 1 --2- 172.21.15.155:0/3991423500 >> v2:172.21.15.191:3300/0 conn(0x7f33c0152ef0 0x7f33c015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:22.718 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33bffff640 1 --2- 172.21.15.155:0/3991423500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c006ffd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f33c00ce5b0 tx=0x7f33b802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94facadde650a288 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33be7fc640 1 -- 172.21.15.155:0/3991423500 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8036070 con 0x7f33c015d040 2024-04-25T13:17:22.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33be7fc640 1 -- 172.21.15.155:0/3991423500 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b8031600 con 0x7f33c015d040 2024-04-25T13:17:22.719 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33be7fc640 1 -- 172.21.15.155:0/3991423500 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b80319f0 con 0x7f33c015d040 2024-04-25T13:17:22.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 -- 172.21.15.155:0/3991423500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 msgr2=0x7f33c006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/3991423500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c006ffd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f33c00ce5b0 tx=0x7f33b802a7c0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 -- 172.21.15.155:0/3991423500 shutdown_connections 2024-04-25T13:17:22.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/3991423500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c006ffd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/3991423500 >> v2:172.21.15.191:3300/0 conn(0x7f33c0152ef0 0x7f33c015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.723 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 -- 172.21.15.155:0/3991423500 >> 172.21.15.155:0/3991423500 conn(0x7f33c006b920 msgr2=0x7f33c006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 -- 172.21.15.155:0/3991423500 shutdown_connections 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.716+0000 7f33c5f6f640 1 -- 172.21.15.155:0/3991423500 wait complete. 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 Processor -- start 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 -- start start 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33c0152ef0 0x7f33c0150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33c0158e50 0x7f33c014c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.724 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33c015c5e0 con 0x7f33c015d040 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f33c0159ba0 con 0x7f33c0152ef0 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.718+0000 7f33c5f6f640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f33c0075460 con 0x7f33c0158e50 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c014a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58662/0 (socket says 172.21.15.155:58662) 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 -- 172.21.15.155:0/859524699 learned_addr learned my addr 172.21.15.155:0/859524699 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:22.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33beffd640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33c0158e50 0x7f33c014c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bf7fe640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33c0152ef0 0x7f33c0150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 -- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33c0158e50 msgr2=0x7f33c014c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33c0158e50 0x7f33c014c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 -- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33c0152ef0 msgr2=0x7f33c0150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33c0152ef0 0x7f33c0150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 -- 172.21.15.155:0/859524699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c01e44b0 con 0x7f33c015d040 2024-04-25T13:17:22.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33bffff640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c014a340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f33b802a800 tx=0x7f33b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8036050 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b8042070 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c01e4790 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8009510 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.719+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c01e4d50 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.720+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c015ce30 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.721+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33b8004470 con 0x7f33c015d040 2024-04-25T13:17:22.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.721+0000 7f33a7fff640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f33ac06c8f0 0x7f33ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:22.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.721+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f33b80acd10 con 0x7f33c015d040 2024-04-25T13:17:22.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.721+0000 7f33bf7fe640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f33ac06c8f0 0x7f33ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:22.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.721+0000 7f33bf7fe640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f33ac06c8f0 0x7f33ac06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33b0006fd0 tx=0x7f33b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:22.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.726+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33c015ce30 con 0x7f33c015d040 2024-04-25T13:17:22.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.903+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f33c0068f50 con 0x7f33c015d040 2024-04-25T13:17:22.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.904+0000 7f33a7fff640 1 -- 172.21.15.155:0/859524699 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f33b807a660 con 0x7f33c015d040 2024-04-25T13:17:22.905 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 64 2024-04-25T13:17:22.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f33ac06c8f0 msgr2=0x7f33ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f33ac06c8f0 0x7f33ac06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f33b0006fd0 tx=0x7f33b0008040 comp rx=0 tx=0).stop 2024-04-25T13:17:22.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 msgr2=0x7f33c014a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:22.907 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c014a340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f33b802a800 tx=0x7f33b8004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 shutdown_connections 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33c015d040 0x7f33c014a340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f33ac06c8f0 0x7f33ac06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f33c0158e50 0x7f33c014c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 --2- 172.21.15.155:0/859524699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f33c0152ef0 0x7f33c0150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 >> 172.21.15.155:0/859524699 conn(0x7f33c006b920 msgr2=0x7f33c0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 shutdown_connections 2024-04-25T13:17:22.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:22.906+0000 7f33c5f6f640 1 -- 172.21.15.155:0/859524699 wait complete. 2024-04-25T13:17:22.918 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T13:17:23.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.017+0000 7fbf4af51640 1 Processor -- start 2024-04-25T13:17:23.019 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.017+0000 7fbf4af51640 1 -- start start 2024-04-25T13:17:23.021 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf4af51640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf44074fc0 0x7fbf44072e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf4af51640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fbf44154c40 0x7fbf44155090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf4af51640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf441555d0 con 0x7fbf440753a0 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf4af51640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4415b100 con 0x7fbf44074fc0 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf4af51640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fbf4415b3c0 con 0x7fbf44154c40 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf48ced640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbf44074fc0 0x7fbf44072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf43fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fbf440753a0 0x7fbf44070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:41812/0 (socket says 172.21.15.155:41812) 2024-04-25T13:17:23.022 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf43fff640 1 -- 172.21.15.155:0/1383518827 learned_addr learned my addr 172.21.15.155:0/1383518827 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf494ee640 1 --2- 172.21.15.155:0/1383518827 >> v2:172.21.15.191:3300/0 conn(0x7fbf44154c40 0x7fbf44155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf48ced640 1 -- 172.21.15.155:0/1383518827 >> v2:172.21.15.191:3300/0 conn(0x7fbf44154c40 msgr2=0x7fbf44155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf48ced640 1 --2- 172.21.15.155:0/1383518827 >> v2:172.21.15.191:3300/0 conn(0x7fbf44154c40 0x7fbf44155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf48ced640 1 -- 172.21.15.155:0/1383518827 >> v1:172.21.15.155:6789/0 conn(0x7fbf440753a0 legacy=0x7fbf44070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf48ced640 1 -- 172.21.15.155:0/1383518827 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4415b6a0 con 0x7fbf44074fc0 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.018+0000 7fbf437fe640 1 -- 172.21.15.155:0/1383518827 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454222513 0 0) 0x7fbf441555d0 con 0x7fbf440753a0 2024-04-25T13:17:23.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.019+0000 7fbf48ced640 1 --2- 172.21.15.155:0/1383518827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44072e80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf441559c0 tx=0x7fbf3802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920b3b60f6a42e63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.019+0000 7fbf437fe640 1 -- 172.21.15.155:0/1383518827 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037070 con 0x7fbf44074fc0 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.019+0000 7fbf437fe640 1 -- 172.21.15.155:0/1383518827 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38032440 con 0x7fbf44074fc0 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.019+0000 7fbf437fe640 1 -- 172.21.15.155:0/1383518827 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3802ae60 con 0x7fbf44074fc0 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 -- 172.21.15.155:0/1383518827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 msgr2=0x7fbf44072e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 --2- 172.21.15.155:0/1383518827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44072e80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbf441559c0 tx=0x7fbf3802a110 comp rx=0 tx=0).stop 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 -- 172.21.15.155:0/1383518827 shutdown_connections 2024-04-25T13:17:23.024 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 --2- 172.21.15.155:0/1383518827 >> v2:172.21.15.191:3300/0 conn(0x7fbf44154c40 0x7fbf44155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 --2- 172.21.15.155:0/1383518827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44072e80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 -- 172.21.15.155:0/1383518827 >> 172.21.15.155:0/1383518827 conn(0x7fbf4406b920 msgr2=0x7fbf4406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 -- 172.21.15.155:0/1383518827 shutdown_connections 2024-04-25T13:17:23.025 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.020+0000 7fbf4af51640 1 -- 172.21.15.155:0/1383518827 wait complete. 2024-04-25T13:17:23.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.021+0000 7fbf4af51640 1 Processor -- start 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.021+0000 7fbf4af51640 1 -- start start 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf4af51640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf4af51640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf440753a0 0x7fbf4414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf4af51640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf44154c40 0x7fbf4414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf4af51640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44070b50 con 0x7fbf44074fc0 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf4af51640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4415bc60 con 0x7fbf44154c40 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf4af51640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fbf44070cd0 con 0x7fbf440753a0 2024-04-25T13:17:23.028 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58682/0 (socket says 172.21.15.155:58682) 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 -- 172.21.15.155:0/3279247890 learned_addr learned my addr 172.21.15.155:0/3279247890 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf494ee640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf44154c40 0x7fbf4414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf43fff640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf440753a0 0x7fbf4414c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 -- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf440753a0 msgr2=0x7fbf4414c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf440753a0 0x7fbf4414c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.029 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 -- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf44154c40 msgr2=0x7fbf4414a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf44154c40 0x7fbf4414a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 -- 172.21.15.155:0/3279247890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44150520 con 0x7fbf44074fc0 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf43fff640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf440753a0 0x7fbf4414c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.022+0000 7fbf48ced640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44152610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009890 tx=0x7fbf380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.023+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38037040 con 0x7fbf44074fc0 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.023+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf38042070 con 0x7fbf44074fc0 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.023+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38030bd0 con 0x7fbf44074fc0 2024-04-25T13:17:23.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.023+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf44152e50 con 0x7fbf44074fc0 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.023+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf440ccda0 con 0x7fbf44074fc0 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.024+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf44068e40 con 0x7fbf44074fc0 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.024+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf38047460 con 0x7fbf44074fc0 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.024+0000 7fbf417fa640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbf2806c8f0 0x7fbf2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.025+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbf380acc60 con 0x7fbf44074fc0 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.025+0000 7fbf43fff640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbf2806c8f0 0x7fbf2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.031 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.025+0000 7fbf43fff640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbf2806c8f0 0x7fbf2806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf440ce3e0 tx=0x7fbf30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.032 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.029+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf44150520 con 0x7fbf44074fc0 2024-04-25T13:17:23.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.203+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbf4406c110 con 0x7fbf44074fc0 2024-04-25T13:17:23.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.203+0000 7fbf417fa640 1 -- 172.21.15.155:0/3279247890 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fbf380ac030 con 0x7fbf44074fc0 2024-04-25T13:17:23.204 INFO:teuthology.orchestra.run.smithi155.stdout:pg_num: 32 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbf2806c8f0 msgr2=0x7fbf2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbf2806c8f0 0x7fbf2806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbf440ce3e0 tx=0x7fbf30009040 comp rx=0 tx=0).stop 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 msgr2=0x7fbf44152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44152610 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbf38009890 tx=0x7fbf380046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 shutdown_connections 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbf44154c40 0x7fbf4414a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fbf2806c8f0 0x7fbf2806edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fbf440753a0 0x7fbf4414c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 --2- 172.21.15.155:0/3279247890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf44074fc0 0x7fbf44152610 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 >> 172.21.15.155:0/3279247890 conn(0x7fbf4406b920 msgr2=0x7fbf440cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 shutdown_connections 2024-04-25T13:17:23.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.205+0000 7fbf4af51640 1 -- 172.21.15.155:0/3279247890 wait complete. 2024-04-25T13:17:23.217 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:17:23.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.314+0000 7f95f9efd640 1 Processor -- start 2024-04-25T13:17:23.315 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.314+0000 7f95f9efd640 1 -- start start 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f9efd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95f40cb440 0x7f95f40caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f9efd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f95f40c9fa0 0x7f95f40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f9efd640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95f40c9bb0 con 0x7f95f415c6c0 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f9efd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f95f40c5a70 con 0x7f95f40cb440 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f9efd640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f95f40c5cc0 con 0x7f95f40c9fa0 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95f40cb440 0x7f95f40caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f95f40cb440 0x7f95f40caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58690/0 (socket says 172.21.15.155:58690) 2024-04-25T13:17:23.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 -- 172.21.15.155:0/2274229153 learned_addr learned my addr 172.21.15.155:0/2274229153 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f2ffd640 1 --2- 172.21.15.155:0/2274229153 >> v2:172.21.15.191:3300/0 conn(0x7f95f40c9fa0 0x7f95f40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 -- 172.21.15.155:0/2274229153 >> v2:172.21.15.191:3300/0 conn(0x7f95f40c9fa0 msgr2=0x7f95f40cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 --2- 172.21.15.155:0/2274229153 >> v2:172.21.15.191:3300/0 conn(0x7f95f40c9fa0 0x7f95f40cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 -- 172.21.15.155:0/2274229153 >> v1:172.21.15.191:6789/0 conn(0x7f95f415c6c0 legacy=0x7f95f40732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.315+0000 7f95f37fe640 1 -- 172.21.15.155:0/2274229153 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f40c5fa0 con 0x7f95f40cb440 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f37fe640 1 --2- 172.21.15.155:0/2274229153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f40cb440 0x7f95f40caa30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009870 tx=0x7f95e402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b61115256061b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f27fc640 1 -- 172.21.15.155:0/2274229153 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4037070 con 0x7f95f40cb440 2024-04-25T13:17:23.318 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f27fc640 1 -- 172.21.15.155:0/2274229153 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e4032440 con 0x7f95f40cb440 2024-04-25T13:17:23.319 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f27fc640 1 -- 172.21.15.155:0/2274229153 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4032810 con 0x7f95f40cb440 2024-04-25T13:17:23.321 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f9efd640 1 -- 172.21.15.155:0/2274229153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f40cb440 msgr2=0x7f95f40caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f9efd640 1 --2- 172.21.15.155:0/2274229153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f40cb440 0x7f95f40caa30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009870 tx=0x7f95e402a2a0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f9efd640 1 -- 172.21.15.155:0/2274229153 shutdown_connections 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f9efd640 1 --2- 172.21.15.155:0/2274229153 >> v2:172.21.15.191:3300/0 conn(0x7f95f40c9fa0 0x7f95f40cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f9efd640 1 --2- 172.21.15.155:0/2274229153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f40cb440 0x7f95f40caa30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.316+0000 7f95f9efd640 1 -- 172.21.15.155:0/2274229153 >> 172.21.15.155:0/2274229153 conn(0x7f95f4074f30 msgr2=0x7f95f4075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.317+0000 7f95f9efd640 1 -- 172.21.15.155:0/2274229153 shutdown_connections 2024-04-25T13:17:23.322 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.317+0000 7f95f9efd640 1 -- 172.21.15.155:0/2274229153 wait complete. 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 Processor -- start 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 -- start start 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95f40c9fa0 0x7f95f4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95f40cb440 0x7f95f414a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 0x7f95f41488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95f40c9850 con 0x7f95f415c6c0 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f95f40ca720 con 0x7f95f40cb440 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.318+0000 7f95f9efd640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f95f4153360 con 0x7f95f40c9fa0 2024-04-25T13:17:23.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 0x7f95f41488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 0x7f95f41488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58704/0 (socket says 172.21.15.155:58704) 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 -- 172.21.15.155:0/484446347 learned_addr learned my addr 172.21.15.155:0/484446347 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f2ffd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95f40cb440 0x7f95f414a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f37fe640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95f40c9fa0 0x7f95f4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 -- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95f40c9fa0 msgr2=0x7f95f4156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95f40c9fa0 0x7f95f4156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 -- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95f40cb440 msgr2=0x7f95f414a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95f40cb440 0x7f95f414a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 -- 172.21.15.155:0/484446347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f4157a10 con 0x7f95f415c6c0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f2ffd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95f40cb440 0x7f95f414a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f37fe640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95f40c9fa0 0x7f95f4156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f3fff640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 0x7f95f41488b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c6b0 tx=0x7f95ec00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec003b70 con 0x7f95f415c6c0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ec003d30 con 0x7f95f415c6c0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f4157500 con 0x7f95f415c6c0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005310 con 0x7f95f415c6c0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.319+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f4158750 con 0x7f95f415c6c0 2024-04-25T13:17:23.325 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.320+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f4068e40 con 0x7f95f415c6c0 2024-04-25T13:17:23.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.321+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95ec0054b0 con 0x7f95f415c6c0 2024-04-25T13:17:23.326 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.321+0000 7f95dbfff640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f95e006c8f0 0x7f95e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:23.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.321+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f95ec08bd20 con 0x7f95f415c6c0 2024-04-25T13:17:23.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.321+0000 7f95f37fe640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f95e006c8f0 0x7f95e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:23.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.322+0000 7f95f37fe640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f95e006c8f0 0x7f95e006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f95e4034000 tx=0x7f95e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:23.327 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.325+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95ec059de0 con 0x7f95f415c6c0 2024-04-25T13:17:23.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.513+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95f4071c30 con 0x7f95f415c6c0 2024-04-25T13:17:23.515 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.513+0000 7f95dbfff640 1 -- 172.21.15.155:0/484446347 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f95ec0596e0 con 0x7f95f415c6c0 2024-04-25T13:17:23.515 INFO:teuthology.orchestra.run.smithi155.stderr:listed 0 entries 2024-04-25T13:17:23.516 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f95e006c8f0 msgr2=0x7f95e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f95e006c8f0 0x7f95e006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f95e4034000 tx=0x7f95e402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 msgr2=0x7f95f41488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 0x7f95f41488b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c6b0 tx=0x7f95ec00cb70 comp rx=0 tx=0).stop 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 shutdown_connections 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f415c6c0 0x7f95f41488b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f95f40cb440 0x7f95f414a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f95e006c8f0 0x7f95e006edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 --2- 172.21.15.155:0/484446347 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f95f40c9fa0 0x7f95f4156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:23.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 >> 172.21.15.155:0/484446347 conn(0x7f95f4074f30 msgr2=0x7f95f415cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:23.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 shutdown_connections 2024-04-25T13:17:23.518 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:23.515+0000 7f95f9efd640 1 -- 172.21.15.155:0/484446347 wait complete. 2024-04-25T13:17:23.527 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi155.front.sepia.ceph.com... 2024-04-25T13:17:23.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:23.528 DEBUG:teuthology.orchestra.run.smithi155:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T13:17:23.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi155.stderr:ceph-fuse[46184]: fuse finished with error 0 and tester_r 0 2024-04-25T13:17:23.551 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:17:29.653 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:17:29.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:29.653 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:17:29.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:29.673 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-04-25T13:17:29.730 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:17:29.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:29.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:17:29.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:17:29.798 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-04-25T13:17:29.894 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T13:17:29.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:17:29.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:30.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.004+0000 7f538c920640 1 Processor -- start 2024-04-25T13:17:30.006 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.004+0000 7f538c920640 1 -- start start 2024-04-25T13:17:30.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.005+0000 7f538c920640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f53881517a0 0x7f53880c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.005+0000 7f538c920640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53880c3900 0x7f5388161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.005+0000 7f538c920640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5388158570 con 0x7f5388151b80 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.005+0000 7f538c920640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f53880c6f30 con 0x7f53880c3900 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.005+0000 7f538c920640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f53880c8cc0 con 0x7f53881517a0 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53880c3900 0x7f5388161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f53880c3900 0x7f5388161ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58706/0 (socket says 172.21.15.155:58706) 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 -- 172.21.15.155:0/2588455507 learned_addr learned my addr 172.21.15.155:0/2588455507 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:30.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f538659c640 1 --2- 172.21.15.155:0/2588455507 >> v2:172.21.15.191:3300/0 conn(0x7f53881517a0 0x7f53880c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 -- 172.21.15.155:0/2588455507 >> v2:172.21.15.191:3300/0 conn(0x7f53881517a0 msgr2=0x7f53880c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 --2- 172.21.15.155:0/2588455507 >> v2:172.21.15.191:3300/0 conn(0x7f53881517a0 0x7f53880c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 -- 172.21.15.155:0/2588455507 >> v1:172.21.15.155:6789/0 conn(0x7f5388151b80 legacy=0x7f538806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f5386d9d640 1 -- 172.21.15.155:0/2588455507 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53880c71d0 con 0x7f53880c3900 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.006+0000 7f538659c640 1 --2- 172.21.15.155:0/2588455507 >> v2:172.21.15.191:3300/0 conn(0x7f53881517a0 0x7f53880c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f5386d9d640 1 --2- 172.21.15.155:0/2588455507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53880c3900 0x7f5388161ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f538806c320 tx=0x7f537802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fd8d49989927af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538559a640 1 -- 172.21.15.155:0/2588455507 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378036020 con 0x7f53880c3900 2024-04-25T13:17:30.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538559a640 1 -- 172.21.15.155:0/2588455507 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378032640 con 0x7f53880c3900 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538559a640 1 -- 172.21.15.155:0/2588455507 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378032a10 con 0x7f53880c3900 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 -- 172.21.15.155:0/2588455507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53880c3900 msgr2=0x7f5388161ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 --2- 172.21.15.155:0/2588455507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53880c3900 0x7f5388161ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f538806c320 tx=0x7f537802c940 comp rx=0 tx=0).stop 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 -- 172.21.15.155:0/2588455507 shutdown_connections 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 --2- 172.21.15.155:0/2588455507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53880c3900 0x7f5388161ea0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 --2- 172.21.15.155:0/2588455507 >> v2:172.21.15.191:3300/0 conn(0x7f53881517a0 0x7f53880c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 -- 172.21.15.155:0/2588455507 >> 172.21.15.155:0/2588455507 conn(0x7f53880c8f00 msgr2=0x7f53880c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 -- 172.21.15.155:0/2588455507 shutdown_connections 2024-04-25T13:17:30.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.007+0000 7f538c920640 1 -- 172.21.15.155:0/2588455507 wait complete. 2024-04-25T13:17:30.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.009+0000 7f538c920640 1 Processor -- start 2024-04-25T13:17:30.014 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.009+0000 7f538c920640 1 -- start start 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53880c3900 0x7f5388152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 0x7f538806f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53880ca9a0 0x7f53880cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53880c7a70 con 0x7f53881517a0 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f53880c7790 con 0x7f53880c3900 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f53880c7f90 con 0x7f53880ca9a0 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 0x7f538806f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.015 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 0x7f538806f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58716/0 (socket says 172.21.15.155:58716) 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 -- 172.21.15.155:0/2715617485 learned_addr learned my addr 172.21.15.155:0/2715617485 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538659c640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53880c3900 0x7f5388152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5386d9d640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53880ca9a0 0x7f53880cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 -- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53880ca9a0 msgr2=0x7f53880cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53880ca9a0 0x7f53880cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 -- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53880c3900 msgr2=0x7f5388152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53880c3900 0x7f5388152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 -- 172.21.15.155:0/2715617485 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53880cb450 con 0x7f53881517a0 2024-04-25T13:17:30.016 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5385d9b640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 0x7f538806f240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f537c00c400 tx=0x7f537c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c0052d0 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c005490 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c007260 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53881543f0 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.010+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53881549b0 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.012+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53880c9b30 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.012+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f537c007400 con 0x7f53881517a0 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.012+0000 7f5376ffd640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f536806c8f0 0x7f536806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.017 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.012+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f537c08b4a0 con 0x7f53881517a0 2024-04-25T13:17:30.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.012+0000 7f538659c640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f536806c8f0 0x7f536806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.013+0000 7f538659c640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f536806c8f0 0x7f536806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53800075b0 tx=0x7f5380007540 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.018 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.017+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53880c9b30 con 0x7f53881517a0 2024-04-25T13:17:30.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.187+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5388068e40 con 0x7f536806c8f0 2024-04-25T13:17:30.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.195+0000 7f5376ffd640 1 -- 172.21.15.155:0/2715617485 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f5388068e40 con 0x7f536806c8f0 2024-04-25T13:17:30.200 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:30.202 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f536806c8f0 msgr2=0x7f536806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f536806c8f0 0x7f536806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f53800075b0 tx=0x7f5380007540 comp rx=0 tx=0).stop 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 msgr2=0x7f538806f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 0x7f538806f240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f537c00c400 tx=0x7f537c00c8c0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 shutdown_connections 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f536806c8f0 0x7f536806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f53880ca9a0 0x7f53880cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53881517a0 0x7f538806f240 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 --2- 172.21.15.155:0/2715617485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f53880c3900 0x7f5388152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 >> 172.21.15.155:0/2715617485 conn(0x7f53880c8f00 msgr2=0x7f5388150480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:30.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 shutdown_connections 2024-04-25T13:17:30.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.199+0000 7f538c920640 1 -- 172.21.15.155:0/2715617485 wait complete. 2024-04-25T13:17:30.211 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T13:17:29.632074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219816,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754904,"statfs":{"total":773094113280,"available":772869021696,"internally_reserved":0,"allocated":3776512,"data_stored":2158240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002339"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835797+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:17:10.835797+0000","last_peered":"2024-04-25T13:17:10.835797+0000","last_clean":"2024-04-25T13:17:10.835797+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:17:10.835797+0000","last_undegraded":"2024-04-25T13:17:10.835797+0000","last_fullsized":"2024-04-25T13:17:10.835797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510369+0000","last_change":"2024-04-25T13:17:03.509734+0000","last_active":"2024-04-25T13:17:03.510369+0000","last_peered":"2024-04-25T13:17:03.510369+0000","last_clean":"2024-04-25T13:17:03.510369+0000","last_became_active":"2024-04-25T13:17:03.509296+0000","last_became_peered":"2024-04-25T13:17:03.509296+0000","last_unstale":"2024-04-25T13:17:03.510369+0000","last_undegraded":"2024-04-25T13:17:03.510369+0000","last_fullsized":"2024-04-25T13:17:03.510369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:40.776398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811834+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:17:02.811834+0000","last_peered":"2024-04-25T13:17:02.811834+0000","last_clean":"2024-04-25T13:17:02.811834+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:17:02.811834+0000","last_undegraded":"2024-04-25T13:17:02.811834+0000","last_fullsized":"2024-04-25T13:17:02.811834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812634+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:17:02.812634+0000","last_peered":"2024-04-25T13:17:02.812634+0000","last_clean":"2024-04-25T13:17:02.812634+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:17:02.812634+0000","last_undegraded":"2024-04-25T13:17:02.812634+0000","last_fullsized":"2024-04-25T13:17:02.812634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814541+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:17:02.814541+0000","last_peered":"2024-04-25T13:17:02.814541+0000","last_clean":"2024-04-25T13:17:02.814541+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:17:02.814541+0000","last_undegraded":"2024-04-25T13:17:02.814541+0000","last_fullsized":"2024-04-25T13:17:02.814541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507295+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:17:03.507295+0000","last_peered":"2024-04-25T13:17:03.507295+0000","last_clean":"2024-04-25T13:17:03.507295+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:17:03.507295+0000","last_undegraded":"2024-04-25T13:17:03.507295+0000","last_fullsized":"2024-04-25T13:17:03.507295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836728+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:17:10.836728+0000","last_peered":"2024-04-25T13:17:10.836728+0000","last_clean":"2024-04-25T13:17:10.836728+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:17:10.836728+0000","last_undegraded":"2024-04-25T13:17:10.836728+0000","last_fullsized":"2024-04-25T13:17:10.836728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814019+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:17:02.814019+0000","last_peered":"2024-04-25T13:17:02.814019+0000","last_clean":"2024-04-25T13:17:02.814019+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:17:02.814019+0000","last_undegraded":"2024-04-25T13:17:02.814019+0000","last_fullsized":"2024-04-25T13:17:02.814019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507708+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:17:03.507708+0000","last_peered":"2024-04-25T13:17:03.507708+0000","last_clean":"2024-04-25T13:17:03.507708+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:17:03.507708+0000","last_undegraded":"2024-04-25T13:17:03.507708+0000","last_fullsized":"2024-04-25T13:17:03.507708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836368+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:17:10.836368+0000","last_peered":"2024-04-25T13:17:10.836368+0000","last_clean":"2024-04-25T13:17:10.836368+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:17:10.836368+0000","last_undegraded":"2024-04-25T13:17:10.836368+0000","last_fullsized":"2024-04-25T13:17:10.836368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814079+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:17:02.814079+0000","last_peered":"2024-04-25T13:17:02.814079+0000","last_clean":"2024-04-25T13:17:02.814079+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:17:02.814079+0000","last_undegraded":"2024-04-25T13:17:02.814079+0000","last_fullsized":"2024-04-25T13:17:02.814079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507393+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:17:03.507393+0000","last_peered":"2024-04-25T13:17:03.507393+0000","last_clean":"2024-04-25T13:17:03.507393+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:17:03.507393+0000","last_undegraded":"2024-04-25T13:17:03.507393+0000","last_fullsized":"2024-04-25T13:17:03.507393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507939+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:17:03.507939+0000","last_peered":"2024-04-25T13:17:03.507939+0000","last_clean":"2024-04-25T13:17:03.507939+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:17:03.507939+0000","last_undegraded":"2024-04-25T13:17:03.507939+0000","last_fullsized":"2024-04-25T13:17:03.507939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811751+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:17:02.811751+0000","last_peered":"2024-04-25T13:17:02.811751+0000","last_clean":"2024-04-25T13:17:02.811751+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:17:02.811751+0000","last_undegraded":"2024-04-25T13:17:02.811751+0000","last_fullsized":"2024-04-25T13:17:02.811751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507691+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:17:03.507691+0000","last_peered":"2024-04-25T13:17:03.507691+0000","last_clean":"2024-04-25T13:17:03.507691+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:17:03.507691+0000","last_undegraded":"2024-04-25T13:17:03.507691+0000","last_fullsized":"2024-04-25T13:17:03.507691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812072+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:17:02.812072+0000","last_peered":"2024-04-25T13:17:02.812072+0000","last_clean":"2024-04-25T13:17:02.812072+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:17:02.812072+0000","last_undegraded":"2024-04-25T13:17:02.812072+0000","last_fullsized":"2024-04-25T13:17:02.812072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813464+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:17:04.813464+0000","last_peered":"2024-04-25T13:17:04.813464+0000","last_clean":"2024-04-25T13:17:04.813464+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:17:04.813464+0000","last_undegraded":"2024-04-25T13:17:04.813464+0000","last_fullsized":"2024-04-25T13:17:04.813464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507510+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:17:03.507510+0000","last_peered":"2024-04-25T13:17:03.507510+0000","last_clean":"2024-04-25T13:17:03.507510+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:17:03.507510+0000","last_undegraded":"2024-04-25T13:17:03.507510+0000","last_fullsized":"2024-04-25T13:17:03.507510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811882+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:17:02.811882+0000","last_peered":"2024-04-25T13:17:02.811882+0000","last_clean":"2024-04-25T13:17:02.811882+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:17:02.811882+0000","last_undegraded":"2024-04-25T13:17:02.811882+0000","last_fullsized":"2024-04-25T13:17:02.811882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.831521+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:17:10.831521+0000","last_peered":"2024-04-25T13:17:10.831521+0000","last_clean":"2024-04-25T13:17:10.831521+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:17:10.831521+0000","last_undegraded":"2024-04-25T13:17:10.831521+0000","last_fullsized":"2024-04-25T13:17:10.831521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814919+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:17:02.814919+0000","last_peered":"2024-04-25T13:17:02.814919+0000","last_clean":"2024-04-25T13:17:02.814919+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:17:02.814919+0000","last_undegraded":"2024-04-25T13:17:02.814919+0000","last_fullsized":"2024-04-25T13:17:02.814919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508089+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:17:03.508089+0000","last_peered":"2024-04-25T13:17:03.508089+0000","last_clean":"2024-04-25T13:17:03.508089+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:17:03.508089+0000","last_undegraded":"2024-04-25T13:17:03.508089+0000","last_fullsized":"2024-04-25T13:17:03.508089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811200+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:17:02.811200+0000","last_peered":"2024-04-25T13:17:02.811200+0000","last_clean":"2024-04-25T13:17:02.811200+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:17:02.811200+0000","last_undegraded":"2024-04-25T13:17:02.811200+0000","last_fullsized":"2024-04-25T13:17:02.811200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507642+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:17:03.507642+0000","last_peered":"2024-04-25T13:17:03.507642+0000","last_clean":"2024-04-25T13:17:03.507642+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:17:03.507642+0000","last_undegraded":"2024-04-25T13:17:03.507642+0000","last_fullsized":"2024-04-25T13:17:03.507642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815381+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:17:02.815381+0000","last_peered":"2024-04-25T13:17:02.815381+0000","last_clean":"2024-04-25T13:17:02.815381+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:17:02.815381+0000","last_undegraded":"2024-04-25T13:17:02.815381+0000","last_fullsized":"2024-04-25T13:17:02.815381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832870+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:17:10.832870+0000","last_peered":"2024-04-25T13:17:10.832870+0000","last_clean":"2024-04-25T13:17:10.832870+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:17:10.832870+0000","last_undegraded":"2024-04-25T13:17:10.832870+0000","last_fullsized":"2024-04-25T13:17:10.832870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507891+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:17:03.507891+0000","last_peered":"2024-04-25T13:17:03.507891+0000","last_clean":"2024-04-25T13:17:03.507891+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:17:03.507891+0000","last_undegraded":"2024-04-25T13:17:03.507891+0000","last_fullsized":"2024-04-25T13:17:03.507891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813293+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:17:02.813293+0000","last_peered":"2024-04-25T13:17:02.813293+0000","last_clean":"2024-04-25T13:17:02.813293+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:17:02.813293+0000","last_undegraded":"2024-04-25T13:17:02.813293+0000","last_fullsized":"2024-04-25T13:17:02.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814681+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:17:04.814681+0000","last_peered":"2024-04-25T13:17:04.814681+0000","last_clean":"2024-04-25T13:17:04.814681+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:17:04.814681+0000","last_undegraded":"2024-04-25T13:17:04.814681+0000","last_fullsized":"2024-04-25T13:17:04.814681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811569+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:17:02.811569+0000","last_peered":"2024-04-25T13:17:02.811569+0000","last_clean":"2024-04-25T13:17:02.811569+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:17:02.811569+0000","last_undegraded":"2024-04-25T13:17:02.811569+0000","last_fullsized":"2024-04-25T13:17:02.811569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814392+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:17:02.814392+0000","last_peered":"2024-04-25T13:17:02.814392+0000","last_clean":"2024-04-25T13:17:02.814392+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:17:02.814392+0000","last_undegraded":"2024-04-25T13:17:02.814392+0000","last_fullsized":"2024-04-25T13:17:02.814392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813543+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:17:04.813543+0000","last_peered":"2024-04-25T13:17:04.813543+0000","last_clean":"2024-04-25T13:17:04.813543+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:17:04.813543+0000","last_undegraded":"2024-04-25T13:17:04.813543+0000","last_fullsized":"2024-04-25T13:17:04.813543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819618+0000","last_change":"2024-04-25T13:17:02.819618+0000","last_active":"2024-04-25T13:17:02.819618+0000","last_peered":"2024-04-25T13:17:02.819618+0000","last_clean":"2024-04-25T13:17:02.819618+0000","last_became_active":"2024-04-25T13:17:02.819016+0000","last_became_peered":"2024-04-25T13:17:02.819016+0000","last_unstale":"2024-04-25T13:17:02.819618+0000","last_undegraded":"2024-04-25T13:17:02.819618+0000","last_fullsized":"2024-04-25T13:17:02.819618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.870384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814175+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:17:02.814175+0000","last_peered":"2024-04-25T13:17:02.814175+0000","last_clean":"2024-04-25T13:17:02.814175+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:17:02.814175+0000","last_undegraded":"2024-04-25T13:17:02.814175+0000","last_fullsized":"2024-04-25T13:17:02.814175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814551+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:17:02.814551+0000","last_peered":"2024-04-25T13:17:02.814551+0000","last_clean":"2024-04-25T13:17:02.814551+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:17:02.814551+0000","last_undegraded":"2024-04-25T13:17:02.814551+0000","last_fullsized":"2024-04-25T13:17:02.814551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813791+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:17:02.813791+0000","last_peered":"2024-04-25T13:17:02.813791+0000","last_clean":"2024-04-25T13:17:02.813791+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:17:02.813791+0000","last_undegraded":"2024-04-25T13:17:02.813791+0000","last_fullsized":"2024-04-25T13:17:02.813791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507846+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:17:03.507846+0000","last_peered":"2024-04-25T13:17:03.507846+0000","last_clean":"2024-04-25T13:17:03.507846+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:17:03.507846+0000","last_undegraded":"2024-04-25T13:17:03.507846+0000","last_fullsized":"2024-04-25T13:17:03.507846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836505+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:17:10.836505+0000","last_peered":"2024-04-25T13:17:10.836505+0000","last_clean":"2024-04-25T13:17:10.836505+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:17:10.836505+0000","last_undegraded":"2024-04-25T13:17:10.836505+0000","last_fullsized":"2024-04-25T13:17:10.836505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510055+0000","last_change":"2024-04-25T13:17:03.509676+0000","last_active":"2024-04-25T13:17:03.510055+0000","last_peered":"2024-04-25T13:17:03.510055+0000","last_clean":"2024-04-25T13:17:03.510055+0000","last_became_active":"2024-04-25T13:17:03.509216+0000","last_became_peered":"2024-04-25T13:17:03.509216+0000","last_unstale":"2024-04-25T13:17:03.510055+0000","last_undegraded":"2024-04-25T13:17:03.510055+0000","last_fullsized":"2024-04-25T13:17:03.510055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:03.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813502+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:17:02.813502+0000","last_peered":"2024-04-25T13:17:02.813502+0000","last_clean":"2024-04-25T13:17:02.813502+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:17:02.813502+0000","last_undegraded":"2024-04-25T13:17:02.813502+0000","last_fullsized":"2024-04-25T13:17:02.813502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832583+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:17:10.832583+0000","last_peered":"2024-04-25T13:17:10.832583+0000","last_clean":"2024-04-25T13:17:10.832583+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:17:10.832583+0000","last_undegraded":"2024-04-25T13:17:10.832583+0000","last_fullsized":"2024-04-25T13:17:10.832583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815038+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:17:02.815038+0000","last_peered":"2024-04-25T13:17:02.815038+0000","last_clean":"2024-04-25T13:17:02.815038+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:17:02.815038+0000","last_undegraded":"2024-04-25T13:17:02.815038+0000","last_fullsized":"2024-04-25T13:17:02.815038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815690+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:17:02.815690+0000","last_peered":"2024-04-25T13:17:02.815690+0000","last_clean":"2024-04-25T13:17:02.815690+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:17:02.815690+0000","last_undegraded":"2024-04-25T13:17:02.815690+0000","last_fullsized":"2024-04-25T13:17:02.815690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811263+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:17:02.811263+0000","last_peered":"2024-04-25T13:17:02.811263+0000","last_clean":"2024-04-25T13:17:02.811263+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:17:02.811263+0000","last_undegraded":"2024-04-25T13:17:02.811263+0000","last_fullsized":"2024-04-25T13:17:02.811263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815166+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:17:02.815166+0000","last_peered":"2024-04-25T13:17:02.815166+0000","last_clean":"2024-04-25T13:17:02.815166+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:17:02.815166+0000","last_undegraded":"2024-04-25T13:17:02.815166+0000","last_fullsized":"2024-04-25T13:17:02.815166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812304+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:17:02.812304+0000","last_peered":"2024-04-25T13:17:02.812304+0000","last_clean":"2024-04-25T13:17:02.812304+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:17:02.812304+0000","last_undegraded":"2024-04-25T13:17:02.812304+0000","last_fullsized":"2024-04-25T13:17:02.812304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813257+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:17:04.813257+0000","last_peered":"2024-04-25T13:17:04.813257+0000","last_clean":"2024-04-25T13:17:04.813257+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:17:04.813257+0000","last_undegraded":"2024-04-25T13:17:04.813257+0000","last_fullsized":"2024-04-25T13:17:04.813257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811317+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:17:02.811317+0000","last_peered":"2024-04-25T13:17:02.811317+0000","last_clean":"2024-04-25T13:17:02.811317+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:17:02.811317+0000","last_undegraded":"2024-04-25T13:17:02.811317+0000","last_fullsized":"2024-04-25T13:17:02.811317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508569+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:17:03.508569+0000","last_peered":"2024-04-25T13:17:03.508569+0000","last_clean":"2024-04-25T13:17:03.508569+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:17:03.508569+0000","last_undegraded":"2024-04-25T13:17:03.508569+0000","last_fullsized":"2024-04-25T13:17:03.508569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811924+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:17:02.811924+0000","last_peered":"2024-04-25T13:17:02.811924+0000","last_clean":"2024-04-25T13:17:02.811924+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:17:02.811924+0000","last_undegraded":"2024-04-25T13:17:02.811924+0000","last_fullsized":"2024-04-25T13:17:02.811924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.113778+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:17:19.113778+0000","last_peered":"2024-04-25T13:17:19.113778+0000","last_clean":"2024-04-25T13:17:19.113778+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:17:19.113778+0000","last_undegraded":"2024-04-25T13:17:19.113778+0000","last_fullsized":"2024-04-25T13:17:19.113778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507938+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:17:03.507938+0000","last_peered":"2024-04-25T13:17:03.507938+0000","last_clean":"2024-04-25T13:17:03.507938+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:17:03.507938+0000","last_undegraded":"2024-04-25T13:17:03.507938+0000","last_fullsized":"2024-04-25T13:17:03.507938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814058+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:17:02.814058+0000","last_peered":"2024-04-25T13:17:02.814058+0000","last_clean":"2024-04-25T13:17:02.814058+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:17:02.814058+0000","last_undegraded":"2024-04-25T13:17:02.814058+0000","last_fullsized":"2024-04-25T13:17:02.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.808777+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:17:04.808777+0000","last_peered":"2024-04-25T13:17:04.808777+0000","last_clean":"2024-04-25T13:17:04.808777+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:17:04.808777+0000","last_undegraded":"2024-04-25T13:17:04.808777+0000","last_fullsized":"2024-04-25T13:17:04.808777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816191+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:17:02.816191+0000","last_peered":"2024-04-25T13:17:02.816191+0000","last_clean":"2024-04-25T13:17:02.816191+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:17:02.816191+0000","last_undegraded":"2024-04-25T13:17:02.816191+0000","last_fullsized":"2024-04-25T13:17:02.816191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812288+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:17:02.812288+0000","last_peered":"2024-04-25T13:17:02.812288+0000","last_clean":"2024-04-25T13:17:02.812288+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:17:02.812288+0000","last_undegraded":"2024-04-25T13:17:02.812288+0000","last_fullsized":"2024-04-25T13:17:02.812288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835384+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:17:10.835384+0000","last_peered":"2024-04-25T13:17:10.835384+0000","last_clean":"2024-04-25T13:17:10.835384+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:17:10.835384+0000","last_undegraded":"2024-04-25T13:17:10.835384+0000","last_fullsized":"2024-04-25T13:17:10.835384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813046+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:17:02.813046+0000","last_peered":"2024-04-25T13:17:02.813046+0000","last_clean":"2024-04-25T13:17:02.813046+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:17:02.813046+0000","last_undegraded":"2024-04-25T13:17:02.813046+0000","last_fullsized":"2024-04-25T13:17:02.813046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811950+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:17:02.811950+0000","last_peered":"2024-04-25T13:17:02.811950+0000","last_clean":"2024-04-25T13:17:02.811950+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:17:02.811950+0000","last_undegraded":"2024-04-25T13:17:02.811950+0000","last_fullsized":"2024-04-25T13:17:02.811950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507795+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:17:03.507795+0000","last_peered":"2024-04-25T13:17:03.507795+0000","last_clean":"2024-04-25T13:17:03.507795+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:17:03.507795+0000","last_undegraded":"2024-04-25T13:17:03.507795+0000","last_fullsized":"2024-04-25T13:17:03.507795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507210+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:17:03.507210+0000","last_peered":"2024-04-25T13:17:03.507210+0000","last_clean":"2024-04-25T13:17:03.507210+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:17:03.507210+0000","last_undegraded":"2024-04-25T13:17:03.507210+0000","last_fullsized":"2024-04-25T13:17:03.507210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811434+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:17:02.811434+0000","last_peered":"2024-04-25T13:17:02.811434+0000","last_clean":"2024-04-25T13:17:02.811434+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:17:02.811434+0000","last_undegraded":"2024-04-25T13:17:02.811434+0000","last_fullsized":"2024-04-25T13:17:02.811434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.810341+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:17:04.810341+0000","last_peered":"2024-04-25T13:17:04.810341+0000","last_clean":"2024-04-25T13:17:04.810341+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:17:04.810341+0000","last_undegraded":"2024-04-25T13:17:04.810341+0000","last_fullsized":"2024-04-25T13:17:04.810341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814520+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:17:02.814520+0000","last_peered":"2024-04-25T13:17:02.814520+0000","last_clean":"2024-04-25T13:17:02.814520+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:17:02.814520+0000","last_undegraded":"2024-04-25T13:17:02.814520+0000","last_fullsized":"2024-04-25T13:17:02.814520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508154+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:17:03.508154+0000","last_peered":"2024-04-25T13:17:03.508154+0000","last_clean":"2024-04-25T13:17:03.508154+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:17:03.508154+0000","last_undegraded":"2024-04-25T13:17:03.508154+0000","last_fullsized":"2024-04-25T13:17:03.508154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.121264+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:17:19.121264+0000","last_peered":"2024-04-25T13:17:19.121264+0000","last_clean":"2024-04-25T13:17:19.121264+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:17:19.121264+0000","last_undegraded":"2024-04-25T13:17:19.121264+0000","last_fullsized":"2024-04-25T13:17:19.121264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812765+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:17:02.812765+0000","last_peered":"2024-04-25T13:17:02.812765+0000","last_clean":"2024-04-25T13:17:02.812765+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:17:02.812765+0000","last_undegraded":"2024-04-25T13:17:02.812765+0000","last_fullsized":"2024-04-25T13:17:02.812765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811663+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:17:02.811663+0000","last_peered":"2024-04-25T13:17:02.811663+0000","last_clean":"2024-04-25T13:17:02.811663+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:17:02.811663+0000","last_undegraded":"2024-04-25T13:17:02.811663+0000","last_fullsized":"2024-04-25T13:17:02.811663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813445+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:17:04.813445+0000","last_peered":"2024-04-25T13:17:04.813445+0000","last_clean":"2024-04-25T13:17:04.813445+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:17:04.813445+0000","last_undegraded":"2024-04-25T13:17:04.813445+0000","last_fullsized":"2024-04-25T13:17:04.813445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.818420+0000","last_change":"2024-04-25T13:17:02.818420+0000","last_active":"2024-04-25T13:17:02.818420+0000","last_peered":"2024-04-25T13:17:02.818420+0000","last_clean":"2024-04-25T13:17:02.818420+0000","last_became_active":"2024-04-25T13:17:02.817864+0000","last_became_peered":"2024-04-25T13:17:02.817864+0000","last_unstale":"2024-04-25T13:17:02.818420+0000","last_undegraded":"2024-04-25T13:17:02.818420+0000","last_fullsized":"2024-04-25T13:17:02.818420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:52.960881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815996+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:17:02.815996+0000","last_peered":"2024-04-25T13:17:02.815996+0000","last_clean":"2024-04-25T13:17:02.815996+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:17:02.815996+0000","last_undegraded":"2024-04-25T13:17:02.815996+0000","last_fullsized":"2024-04-25T13:17:02.815996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836070+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:17:10.836070+0000","last_peered":"2024-04-25T13:17:10.836070+0000","last_clean":"2024-04-25T13:17:10.836070+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:17:10.836070+0000","last_undegraded":"2024-04-25T13:17:10.836070+0000","last_fullsized":"2024-04-25T13:17:10.836070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813967+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:17:02.813967+0000","last_peered":"2024-04-25T13:17:02.813967+0000","last_clean":"2024-04-25T13:17:02.813967+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:17:02.813967+0000","last_undegraded":"2024-04-25T13:17:02.813967+0000","last_fullsized":"2024-04-25T13:17:02.813967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811857+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:17:02.811857+0000","last_peered":"2024-04-25T13:17:02.811857+0000","last_clean":"2024-04-25T13:17:02.811857+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:17:02.811857+0000","last_undegraded":"2024-04-25T13:17:02.811857+0000","last_fullsized":"2024-04-25T13:17:02.811857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.123871+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:17:19.123871+0000","last_peered":"2024-04-25T13:17:19.123871+0000","last_clean":"2024-04-25T13:17:19.123871+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:17:19.123871+0000","last_undegraded":"2024-04-25T13:17:19.123871+0000","last_fullsized":"2024-04-25T13:17:19.123871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813833+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:17:02.813833+0000","last_peered":"2024-04-25T13:17:02.813833+0000","last_clean":"2024-04-25T13:17:02.813833+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:17:02.813833+0000","last_undegraded":"2024-04-25T13:17:02.813833+0000","last_fullsized":"2024-04-25T13:17:02.813833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507633+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:17:03.507633+0000","last_peered":"2024-04-25T13:17:03.507633+0000","last_clean":"2024-04-25T13:17:03.507633+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:17:03.507633+0000","last_undegraded":"2024-04-25T13:17:03.507633+0000","last_fullsized":"2024-04-25T13:17:03.507633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815428+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:17:02.815428+0000","last_peered":"2024-04-25T13:17:02.815428+0000","last_clean":"2024-04-25T13:17:02.815428+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:17:02.815428+0000","last_undegraded":"2024-04-25T13:17:02.815428+0000","last_fullsized":"2024-04-25T13:17:02.815428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507401+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:17:03.507401+0000","last_peered":"2024-04-25T13:17:03.507401+0000","last_clean":"2024-04-25T13:17:03.507401+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:17:03.507401+0000","last_undegraded":"2024-04-25T13:17:03.507401+0000","last_fullsized":"2024-04-25T13:17:03.507401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814768+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:17:02.814768+0000","last_peered":"2024-04-25T13:17:02.814768+0000","last_clean":"2024-04-25T13:17:02.814768+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:17:02.814768+0000","last_undegraded":"2024-04-25T13:17:02.814768+0000","last_fullsized":"2024-04-25T13:17:02.814768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836480+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:17:10.836480+0000","last_peered":"2024-04-25T13:17:10.836480+0000","last_clean":"2024-04-25T13:17:10.836480+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:17:10.836480+0000","last_undegraded":"2024-04-25T13:17:10.836480+0000","last_fullsized":"2024-04-25T13:17:10.836480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811722+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:17:02.811722+0000","last_peered":"2024-04-25T13:17:02.811722+0000","last_clean":"2024-04-25T13:17:02.811722+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:17:02.811722+0000","last_undegraded":"2024-04-25T13:17:02.811722+0000","last_fullsized":"2024-04-25T13:17:02.811722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819428+0000","last_change":"2024-04-25T13:17:02.817603+0000","last_active":"2024-04-25T13:17:02.819428+0000","last_peered":"2024-04-25T13:17:02.819428+0000","last_clean":"2024-04-25T13:17:02.819428+0000","last_became_active":"2024-04-25T13:17:02.817270+0000","last_became_peered":"2024-04-25T13:17:02.817270+0000","last_unstale":"2024-04-25T13:17:02.819428+0000","last_undegraded":"2024-04-25T13:17:02.819428+0000","last_fullsized":"2024-04-25T13:17:02.819428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:29.177195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118727+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:17:19.118727+0000","last_peered":"2024-04-25T13:17:19.118727+0000","last_clean":"2024-04-25T13:17:19.118727+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:17:19.118727+0000","last_undegraded":"2024-04-25T13:17:19.118727+0000","last_fullsized":"2024-04-25T13:17:19.118727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811958+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:17:02.811958+0000","last_peered":"2024-04-25T13:17:02.811958+0000","last_clean":"2024-04-25T13:17:02.811958+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:17:02.811958+0000","last_undegraded":"2024-04-25T13:17:02.811958+0000","last_fullsized":"2024-04-25T13:17:02.811958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814326+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:17:02.814326+0000","last_peered":"2024-04-25T13:17:02.814326+0000","last_clean":"2024-04-25T13:17:02.814326+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:17:02.814326+0000","last_undegraded":"2024-04-25T13:17:02.814326+0000","last_fullsized":"2024-04-25T13:17:02.814326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813605+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:17:02.813605+0000","last_peered":"2024-04-25T13:17:02.813605+0000","last_clean":"2024-04-25T13:17:02.813605+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:17:02.813605+0000","last_undegraded":"2024-04-25T13:17:02.813605+0000","last_fullsized":"2024-04-25T13:17:02.813605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814202+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:17:04.814202+0000","last_peered":"2024-04-25T13:17:04.814202+0000","last_clean":"2024-04-25T13:17:04.814202+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:17:04.814202+0000","last_undegraded":"2024-04-25T13:17:04.814202+0000","last_fullsized":"2024-04-25T13:17:04.814202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508256+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:17:03.508256+0000","last_peered":"2024-04-25T13:17:03.508256+0000","last_clean":"2024-04-25T13:17:03.508256+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:17:03.508256+0000","last_undegraded":"2024-04-25T13:17:03.508256+0000","last_fullsized":"2024-04-25T13:17:03.508256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811828+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:17:02.811828+0000","last_peered":"2024-04-25T13:17:02.811828+0000","last_clean":"2024-04-25T13:17:02.811828+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:17:02.811828+0000","last_undegraded":"2024-04-25T13:17:02.811828+0000","last_fullsized":"2024-04-25T13:17:02.811828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814084+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:17:02.814084+0000","last_peered":"2024-04-25T13:17:02.814084+0000","last_clean":"2024-04-25T13:17:02.814084+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:17:02.814084+0000","last_undegraded":"2024-04-25T13:17:02.814084+0000","last_fullsized":"2024-04-25T13:17:02.814084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814176+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:17:04.814176+0000","last_peered":"2024-04-25T13:17:04.814176+0000","last_clean":"2024-04-25T13:17:04.814176+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:17:04.814176+0000","last_undegraded":"2024-04-25T13:17:04.814176+0000","last_fullsized":"2024-04-25T13:17:04.814176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816379+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:17:02.816379+0000","last_peered":"2024-04-25T13:17:02.816379+0000","last_clean":"2024-04-25T13:17:02.816379+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:17:02.816379+0000","last_undegraded":"2024-04-25T13:17:02.816379+0000","last_fullsized":"2024-04-25T13:17:02.816379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815681+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:17:02.815681+0000","last_peered":"2024-04-25T13:17:02.815681+0000","last_clean":"2024-04-25T13:17:02.815681+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:17:02.815681+0000","last_undegraded":"2024-04-25T13:17:02.815681+0000","last_fullsized":"2024-04-25T13:17:02.815681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118875+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:17:19.118875+0000","last_peered":"2024-04-25T13:17:19.118875+0000","last_clean":"2024-04-25T13:17:19.118875+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:17:19.118875+0000","last_undegraded":"2024-04-25T13:17:19.118875+0000","last_fullsized":"2024-04-25T13:17:19.118875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507498+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:17:03.507498+0000","last_peered":"2024-04-25T13:17:03.507498+0000","last_clean":"2024-04-25T13:17:03.507498+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:17:03.507498+0000","last_undegraded":"2024-04-25T13:17:03.507498+0000","last_fullsized":"2024-04-25T13:17:03.507498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812540+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:17:02.812540+0000","last_peered":"2024-04-25T13:17:02.812540+0000","last_clean":"2024-04-25T13:17:02.812540+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:17:02.812540+0000","last_undegraded":"2024-04-25T13:17:02.812540+0000","last_fullsized":"2024-04-25T13:17:02.812540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508013+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:17:03.508013+0000","last_peered":"2024-04-25T13:17:03.508013+0000","last_clean":"2024-04-25T13:17:03.508013+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:17:03.508013+0000","last_undegraded":"2024-04-25T13:17:03.508013+0000","last_fullsized":"2024-04-25T13:17:03.508013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815859+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:17:02.815859+0000","last_peered":"2024-04-25T13:17:02.815859+0000","last_clean":"2024-04-25T13:17:02.815859+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:17:02.815859+0000","last_undegraded":"2024-04-25T13:17:02.815859+0000","last_fullsized":"2024-04-25T13:17:02.815859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813541+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:17:02.813541+0000","last_peered":"2024-04-25T13:17:02.813541+0000","last_clean":"2024-04-25T13:17:02.813541+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:17:02.813541+0000","last_undegraded":"2024-04-25T13:17:02.813541+0000","last_fullsized":"2024-04-25T13:17:02.813541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816291+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:17:02.816291+0000","last_peered":"2024-04-25T13:17:02.816291+0000","last_clean":"2024-04-25T13:17:02.816291+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:17:02.816291+0000","last_undegraded":"2024-04-25T13:17:02.816291+0000","last_fullsized":"2024-04-25T13:17:02.816291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812966+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:17:02.812966+0000","last_peered":"2024-04-25T13:17:02.812966+0000","last_clean":"2024-04-25T13:17:02.812966+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:17:02.812966+0000","last_undegraded":"2024-04-25T13:17:02.812966+0000","last_fullsized":"2024-04-25T13:17:02.812966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815198+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:17:02.815198+0000","last_peered":"2024-04-25T13:17:02.815198+0000","last_clean":"2024-04-25T13:17:02.815198+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:17:02.815198+0000","last_undegraded":"2024-04-25T13:17:02.815198+0000","last_fullsized":"2024-04-25T13:17:02.815198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508661+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:17:03.508661+0000","last_peered":"2024-04-25T13:17:03.508661+0000","last_clean":"2024-04-25T13:17:03.508661+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:17:03.508661+0000","last_undegraded":"2024-04-25T13:17:03.508661+0000","last_fullsized":"2024-04-25T13:17:03.508661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812859+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:17:02.812859+0000","last_peered":"2024-04-25T13:17:02.812859+0000","last_clean":"2024-04-25T13:17:02.812859+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:17:02.812859+0000","last_undegraded":"2024-04-25T13:17:02.812859+0000","last_fullsized":"2024-04-25T13:17:02.812859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813154+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:17:02.813154+0000","last_peered":"2024-04-25T13:17:02.813154+0000","last_clean":"2024-04-25T13:17:02.813154+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:17:02.813154+0000","last_undegraded":"2024-04-25T13:17:02.813154+0000","last_fullsized":"2024-04-25T13:17:02.813154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812212+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:17:02.812212+0000","last_peered":"2024-04-25T13:17:02.812212+0000","last_clean":"2024-04-25T13:17:02.812212+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:17:02.812212+0000","last_undegraded":"2024-04-25T13:17:02.812212+0000","last_fullsized":"2024-04-25T13:17:02.812212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813496+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:17:02.813496+0000","last_peered":"2024-04-25T13:17:02.813496+0000","last_clean":"2024-04-25T13:17:02.813496+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:17:02.813496+0000","last_undegraded":"2024-04-25T13:17:02.813496+0000","last_fullsized":"2024-04-25T13:17:02.813496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816090+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:17:02.816090+0000","last_peered":"2024-04-25T13:17:02.816090+0000","last_clean":"2024-04-25T13:17:02.816090+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:17:02.816090+0000","last_undegraded":"2024-04-25T13:17:02.816090+0000","last_fullsized":"2024-04-25T13:17:02.816090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508097+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:17:03.508097+0000","last_peered":"2024-04-25T13:17:03.508097+0000","last_clean":"2024-04-25T13:17:03.508097+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:17:03.508097+0000","last_undegraded":"2024-04-25T13:17:03.508097+0000","last_fullsized":"2024-04-25T13:17:03.508097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812095+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:17:02.812095+0000","last_peered":"2024-04-25T13:17:02.812095+0000","last_clean":"2024-04-25T13:17:02.812095+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:17:02.812095+0000","last_undegraded":"2024-04-25T13:17:02.812095+0000","last_fullsized":"2024-04-25T13:17:02.812095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816774+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:17:02.816774+0000","last_peered":"2024-04-25T13:17:02.816774+0000","last_clean":"2024-04-25T13:17:02.816774+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.816774+0000","last_undegraded":"2024-04-25T13:17:02.816774+0000","last_fullsized":"2024-04-25T13:17:02.816774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819531+0000","last_change":"2024-04-25T13:17:02.818074+0000","last_active":"2024-04-25T13:17:02.819531+0000","last_peered":"2024-04-25T13:17:02.819531+0000","last_clean":"2024-04-25T13:17:02.819531+0000","last_became_active":"2024-04-25T13:17:02.817489+0000","last_became_peered":"2024-04-25T13:17:02.817489+0000","last_unstale":"2024-04-25T13:17:02.819531+0000","last_undegraded":"2024-04-25T13:17:02.819531+0000","last_fullsized":"2024-04-25T13:17:02.819531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:24.336162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813129+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:17:02.813129+0000","last_peered":"2024-04-25T13:17:02.813129+0000","last_clean":"2024-04-25T13:17:02.813129+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:17:02.813129+0000","last_undegraded":"2024-04-25T13:17:02.813129+0000","last_fullsized":"2024-04-25T13:17:02.813129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813390+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:17:02.813390+0000","last_peered":"2024-04-25T13:17:02.813390+0000","last_clean":"2024-04-25T13:17:02.813390+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:17:02.813390+0000","last_undegraded":"2024-04-25T13:17:02.813390+0000","last_fullsized":"2024-04-25T13:17:02.813390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815900+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:17:02.815900+0000","last_peered":"2024-04-25T13:17:02.815900+0000","last_clean":"2024-04-25T13:17:02.815900+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:17:02.815900+0000","last_undegraded":"2024-04-25T13:17:02.815900+0000","last_fullsized":"2024-04-25T13:17:02.815900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811962+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:17:02.811962+0000","last_peered":"2024-04-25T13:17:02.811962+0000","last_clean":"2024-04-25T13:17:02.811962+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.811962+0000","last_undegraded":"2024-04-25T13:17:02.811962+0000","last_fullsized":"2024-04-25T13:17:02.811962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507772+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:17:03.507772+0000","last_peered":"2024-04-25T13:17:03.507772+0000","last_clean":"2024-04-25T13:17:03.507772+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:17:03.507772+0000","last_undegraded":"2024-04-25T13:17:03.507772+0000","last_fullsized":"2024-04-25T13:17:03.507772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508579+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:17:03.508579+0000","last_peered":"2024-04-25T13:17:03.508579+0000","last_clean":"2024-04-25T13:17:03.508579+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:17:03.508579+0000","last_undegraded":"2024-04-25T13:17:03.508579+0000","last_fullsized":"2024-04-25T13:17:03.508579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508564+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:17:03.508564+0000","last_peered":"2024-04-25T13:17:03.508564+0000","last_clean":"2024-04-25T13:17:03.508564+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:17:03.508564+0000","last_undegraded":"2024-04-25T13:17:03.508564+0000","last_fullsized":"2024-04-25T13:17:03.508564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.823907+0000","last_change":"2024-04-25T13:17:02.819234+0000","last_active":"2024-04-25T13:17:02.823907+0000","last_peered":"2024-04-25T13:17:02.823907+0000","last_clean":"2024-04-25T13:17:02.823907+0000","last_became_active":"2024-04-25T13:17:02.818740+0000","last_became_peered":"2024-04-25T13:17:02.818740+0000","last_unstale":"2024-04-25T13:17:02.823907+0000","last_undegraded":"2024-04-25T13:17:02.823907+0000","last_fullsized":"2024-04-25T13:17:02.823907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.255803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811710+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:17:02.811710+0000","last_peered":"2024-04-25T13:17:02.811710+0000","last_clean":"2024-04-25T13:17:02.811710+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:17:02.811710+0000","last_undegraded":"2024-04-25T13:17:02.811710+0000","last_fullsized":"2024-04-25T13:17:02.811710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811344+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:17:02.811344+0000","last_peered":"2024-04-25T13:17:02.811344+0000","last_clean":"2024-04-25T13:17:02.811344+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:17:02.811344+0000","last_undegraded":"2024-04-25T13:17:02.811344+0000","last_fullsized":"2024-04-25T13:17:02.811344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813459+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:17:02.813459+0000","last_peered":"2024-04-25T13:17:02.813459+0000","last_clean":"2024-04-25T13:17:02.813459+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:17:02.813459+0000","last_undegraded":"2024-04-25T13:17:02.813459+0000","last_fullsized":"2024-04-25T13:17:02.813459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811565+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:17:02.811565+0000","last_peered":"2024-04-25T13:17:02.811565+0000","last_clean":"2024-04-25T13:17:02.811565+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:17:02.811565+0000","last_undegraded":"2024-04-25T13:17:02.811565+0000","last_fullsized":"2024-04-25T13:17:02.811565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813964+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:17:02.813964+0000","last_peered":"2024-04-25T13:17:02.813964+0000","last_clean":"2024-04-25T13:17:02.813964+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:17:02.813964+0000","last_undegraded":"2024-04-25T13:17:02.813964+0000","last_fullsized":"2024-04-25T13:17:02.813964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814995+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:17:02.814995+0000","last_peered":"2024-04-25T13:17:02.814995+0000","last_clean":"2024-04-25T13:17:02.814995+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:17:02.814995+0000","last_undegraded":"2024-04-25T13:17:02.814995+0000","last_fullsized":"2024-04-25T13:17:02.814995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815920+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:17:02.815920+0000","last_peered":"2024-04-25T13:17:02.815920+0000","last_clean":"2024-04-25T13:17:02.815920+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:17:02.815920+0000","last_undegraded":"2024-04-25T13:17:02.815920+0000","last_fullsized":"2024-04-25T13:17:02.815920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812114+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:17:02.812114+0000","last_peered":"2024-04-25T13:17:02.812114+0000","last_clean":"2024-04-25T13:17:02.812114+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:17:02.812114+0000","last_undegraded":"2024-04-25T13:17:02.812114+0000","last_fullsized":"2024-04-25T13:17:02.812114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":123554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":120952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":124870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":121084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":710282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:30.216 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:30.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.347+0000 7fa0ef9ad640 1 Processor -- start 2024-04-25T13:17:30.348 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.347+0000 7fa0ef9ad640 1 -- start start 2024-04-25T13:17:30.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0ef9ad640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa0e806bb90 0x7fa0e815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0ef9ad640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0e80c99f0 0x7fa0e80c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0ef9ad640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e815bef0 con 0x7fa0e806bf70 2024-04-25T13:17:30.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0ef9ad640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e815f510 con 0x7fa0e80c99f0 2024-04-25T13:17:30.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0ef9ad640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e815b650 con 0x7fa0e806bb90 2024-04-25T13:17:30.350 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0e80c99f0 0x7fa0e80c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa0e80c99f0 0x7fa0e80c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58720/0 (socket says 172.21.15.155:58720) 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 -- 172.21.15.155:0/992491663 learned_addr learned my addr 172.21.15.155:0/992491663 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0ed749640 1 --2- 172.21.15.155:0/992491663 >> v2:172.21.15.191:3300/0 conn(0x7fa0e806bb90 0x7fa0e815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 -- 172.21.15.155:0/992491663 >> v2:172.21.15.191:3300/0 conn(0x7fa0e806bb90 msgr2=0x7fa0e815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 --2- 172.21.15.155:0/992491663 >> v2:172.21.15.191:3300/0 conn(0x7fa0e806bb90 0x7fa0e815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 -- 172.21.15.155:0/992491663 >> v1:172.21.15.191:6789/0 conn(0x7fa0e806bf70 legacy=0x7fa0e815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.348+0000 7fa0edf4a640 1 -- 172.21.15.155:0/992491663 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e815b930 con 0x7fa0e80c99f0 2024-04-25T13:17:30.351 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0edf4a640 1 --2- 172.21.15.155:0/992491663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e80c99f0 0x7fa0e80c9e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa0e806db00 tx=0x7fa0e002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4598ef97610cd66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0dffff640 1 -- 172.21.15.155:0/992491663 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0036070 con 0x7fa0e80c99f0 2024-04-25T13:17:30.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0dffff640 1 -- 172.21.15.155:0/992491663 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e0031600 con 0x7fa0e80c99f0 2024-04-25T13:17:30.352 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0dffff640 1 -- 172.21.15.155:0/992491663 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00319d0 con 0x7fa0e80c99f0 2024-04-25T13:17:30.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/992491663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e80c99f0 msgr2=0x7fa0e80c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/992491663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e80c99f0 0x7fa0e80c9e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa0e806db00 tx=0x7fa0e002a780 comp rx=0 tx=0).stop 2024-04-25T13:17:30.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/992491663 shutdown_connections 2024-04-25T13:17:30.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/992491663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e80c99f0 0x7fa0e80c9e60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.355 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/992491663 >> v2:172.21.15.191:3300/0 conn(0x7fa0e806bb90 0x7fa0e815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.349+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/992491663 >> 172.21.15.155:0/992491663 conn(0x7fa0e8074d50 msgr2=0x7fa0e8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.350+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/992491663 shutdown_connections 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.350+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/992491663 wait complete. 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 Processor -- start 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 -- start start 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0e806bb90 0x7fa0e814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 0x7fa0e81f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0e80c99f0 0x7fa0e80ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e815e8e0 con 0x7fa0e806bf70 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e815e600 con 0x7fa0e806bb90 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ef9ad640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e8074560 con 0x7fa0e80c99f0 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ecf48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 0x7fa0e81f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ecf48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 0x7fa0e81f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58728/0 (socket says 172.21.15.155:58728) 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.351+0000 7fa0ecf48640 1 -- 172.21.15.155:0/3189745069 learned_addr learned my addr 172.21.15.155:0/3189745069 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ed749640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0e806bb90 0x7fa0e814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0edf4a640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0e80c99f0 0x7fa0e80ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ecf48640 1 -- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0e80c99f0 msgr2=0x7fa0e80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ecf48640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0e80c99f0 0x7fa0e80ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ecf48640 1 -- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0e806bb90 msgr2=0x7fa0e814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ecf48640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0e806bb90 0x7fa0e814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ecf48640 1 -- 172.21.15.155:0/3189745069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e81f5510 con 0x7fa0e806bf70 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ed749640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0e806bb90 0x7fa0e814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ecf48640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 0x7fa0e81f4fd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b3c0 tx=0x7fa0d800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8015020 con 0x7fa0e806bf70 2024-04-25T13:17:30.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8011830 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e814dea0 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8011c40 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.352+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e81f47d0 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.353+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e8069e50 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.353+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0d8018020 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.354+0000 7fa0ddffb640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0cc06c8f0 0x7fa0cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.354+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa0d808bc70 con 0x7fa0e806bf70 2024-04-25T13:17:30.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.354+0000 7fa0ed749640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0cc06c8f0 0x7fa0cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.354+0000 7fa0ed749640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0cc06c8f0 0x7fa0cc06edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4006fd0 tx=0x7fa0e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.358+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa0e8069e50 con 0x7fa0e806bf70 2024-04-25T13:17:30.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.530+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0e81f45c0 con 0x7fa0cc06c8f0 2024-04-25T13:17:30.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.538+0000 7fa0ddffb640 1 -- 172.21.15.155:0/3189745069 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7fa0e81f45c0 con 0x7fa0cc06c8f0 2024-04-25T13:17:30.542 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:30.544 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:17:30.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0cc06c8f0 msgr2=0x7fa0cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0cc06c8f0 0x7fa0cc06edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4006fd0 tx=0x7fa0e4008040 comp rx=0 tx=0).stop 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 msgr2=0x7fa0e81f4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 0x7fa0e81f4fd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800b3c0 tx=0x7fa0d800b880 comp rx=0 tx=0).stop 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 shutdown_connections 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa0cc06c8f0 0x7fa0cc06edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa0e80c99f0 0x7fa0e80ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0e806bf70 0x7fa0e81f4fd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 --2- 172.21.15.155:0/3189745069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0e806bb90 0x7fa0e814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 >> 172.21.15.155:0/3189745069 conn(0x7fa0e8074d50 msgr2=0x7fa0e80cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:30.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 shutdown_connections 2024-04-25T13:17:30.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.541+0000 7fa0ef9ad640 1 -- 172.21.15.155:0/3189745069 wait complete. 2024-04-25T13:17:30.553 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T13:17:29.632074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219816,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754904,"statfs":{"total":773094113280,"available":772869021696,"internally_reserved":0,"allocated":3776512,"data_stored":2158240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002339"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835797+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:17:10.835797+0000","last_peered":"2024-04-25T13:17:10.835797+0000","last_clean":"2024-04-25T13:17:10.835797+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:17:10.835797+0000","last_undegraded":"2024-04-25T13:17:10.835797+0000","last_fullsized":"2024-04-25T13:17:10.835797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510369+0000","last_change":"2024-04-25T13:17:03.509734+0000","last_active":"2024-04-25T13:17:03.510369+0000","last_peered":"2024-04-25T13:17:03.510369+0000","last_clean":"2024-04-25T13:17:03.510369+0000","last_became_active":"2024-04-25T13:17:03.509296+0000","last_became_peered":"2024-04-25T13:17:03.509296+0000","last_unstale":"2024-04-25T13:17:03.510369+0000","last_undegraded":"2024-04-25T13:17:03.510369+0000","last_fullsized":"2024-04-25T13:17:03.510369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:40.776398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811834+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:17:02.811834+0000","last_peered":"2024-04-25T13:17:02.811834+0000","last_clean":"2024-04-25T13:17:02.811834+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:17:02.811834+0000","last_undegraded":"2024-04-25T13:17:02.811834+0000","last_fullsized":"2024-04-25T13:17:02.811834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812634+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:17:02.812634+0000","last_peered":"2024-04-25T13:17:02.812634+0000","last_clean":"2024-04-25T13:17:02.812634+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:17:02.812634+0000","last_undegraded":"2024-04-25T13:17:02.812634+0000","last_fullsized":"2024-04-25T13:17:02.812634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814541+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:17:02.814541+0000","last_peered":"2024-04-25T13:17:02.814541+0000","last_clean":"2024-04-25T13:17:02.814541+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:17:02.814541+0000","last_undegraded":"2024-04-25T13:17:02.814541+0000","last_fullsized":"2024-04-25T13:17:02.814541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507295+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:17:03.507295+0000","last_peered":"2024-04-25T13:17:03.507295+0000","last_clean":"2024-04-25T13:17:03.507295+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:17:03.507295+0000","last_undegraded":"2024-04-25T13:17:03.507295+0000","last_fullsized":"2024-04-25T13:17:03.507295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836728+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:17:10.836728+0000","last_peered":"2024-04-25T13:17:10.836728+0000","last_clean":"2024-04-25T13:17:10.836728+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:17:10.836728+0000","last_undegraded":"2024-04-25T13:17:10.836728+0000","last_fullsized":"2024-04-25T13:17:10.836728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814019+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:17:02.814019+0000","last_peered":"2024-04-25T13:17:02.814019+0000","last_clean":"2024-04-25T13:17:02.814019+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:17:02.814019+0000","last_undegraded":"2024-04-25T13:17:02.814019+0000","last_fullsized":"2024-04-25T13:17:02.814019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507708+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:17:03.507708+0000","last_peered":"2024-04-25T13:17:03.507708+0000","last_clean":"2024-04-25T13:17:03.507708+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:17:03.507708+0000","last_undegraded":"2024-04-25T13:17:03.507708+0000","last_fullsized":"2024-04-25T13:17:03.507708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836368+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:17:10.836368+0000","last_peered":"2024-04-25T13:17:10.836368+0000","last_clean":"2024-04-25T13:17:10.836368+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:17:10.836368+0000","last_undegraded":"2024-04-25T13:17:10.836368+0000","last_fullsized":"2024-04-25T13:17:10.836368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814079+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:17:02.814079+0000","last_peered":"2024-04-25T13:17:02.814079+0000","last_clean":"2024-04-25T13:17:02.814079+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:17:02.814079+0000","last_undegraded":"2024-04-25T13:17:02.814079+0000","last_fullsized":"2024-04-25T13:17:02.814079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507393+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:17:03.507393+0000","last_peered":"2024-04-25T13:17:03.507393+0000","last_clean":"2024-04-25T13:17:03.507393+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:17:03.507393+0000","last_undegraded":"2024-04-25T13:17:03.507393+0000","last_fullsized":"2024-04-25T13:17:03.507393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507939+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:17:03.507939+0000","last_peered":"2024-04-25T13:17:03.507939+0000","last_clean":"2024-04-25T13:17:03.507939+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:17:03.507939+0000","last_undegraded":"2024-04-25T13:17:03.507939+0000","last_fullsized":"2024-04-25T13:17:03.507939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811751+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:17:02.811751+0000","last_peered":"2024-04-25T13:17:02.811751+0000","last_clean":"2024-04-25T13:17:02.811751+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:17:02.811751+0000","last_undegraded":"2024-04-25T13:17:02.811751+0000","last_fullsized":"2024-04-25T13:17:02.811751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507691+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:17:03.507691+0000","last_peered":"2024-04-25T13:17:03.507691+0000","last_clean":"2024-04-25T13:17:03.507691+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:17:03.507691+0000","last_undegraded":"2024-04-25T13:17:03.507691+0000","last_fullsized":"2024-04-25T13:17:03.507691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812072+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:17:02.812072+0000","last_peered":"2024-04-25T13:17:02.812072+0000","last_clean":"2024-04-25T13:17:02.812072+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:17:02.812072+0000","last_undegraded":"2024-04-25T13:17:02.812072+0000","last_fullsized":"2024-04-25T13:17:02.812072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813464+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:17:04.813464+0000","last_peered":"2024-04-25T13:17:04.813464+0000","last_clean":"2024-04-25T13:17:04.813464+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:17:04.813464+0000","last_undegraded":"2024-04-25T13:17:04.813464+0000","last_fullsized":"2024-04-25T13:17:04.813464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507510+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:17:03.507510+0000","last_peered":"2024-04-25T13:17:03.507510+0000","last_clean":"2024-04-25T13:17:03.507510+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:17:03.507510+0000","last_undegraded":"2024-04-25T13:17:03.507510+0000","last_fullsized":"2024-04-25T13:17:03.507510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811882+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:17:02.811882+0000","last_peered":"2024-04-25T13:17:02.811882+0000","last_clean":"2024-04-25T13:17:02.811882+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:17:02.811882+0000","last_undegraded":"2024-04-25T13:17:02.811882+0000","last_fullsized":"2024-04-25T13:17:02.811882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.831521+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:17:10.831521+0000","last_peered":"2024-04-25T13:17:10.831521+0000","last_clean":"2024-04-25T13:17:10.831521+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:17:10.831521+0000","last_undegraded":"2024-04-25T13:17:10.831521+0000","last_fullsized":"2024-04-25T13:17:10.831521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814919+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:17:02.814919+0000","last_peered":"2024-04-25T13:17:02.814919+0000","last_clean":"2024-04-25T13:17:02.814919+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:17:02.814919+0000","last_undegraded":"2024-04-25T13:17:02.814919+0000","last_fullsized":"2024-04-25T13:17:02.814919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508089+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:17:03.508089+0000","last_peered":"2024-04-25T13:17:03.508089+0000","last_clean":"2024-04-25T13:17:03.508089+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:17:03.508089+0000","last_undegraded":"2024-04-25T13:17:03.508089+0000","last_fullsized":"2024-04-25T13:17:03.508089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811200+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:17:02.811200+0000","last_peered":"2024-04-25T13:17:02.811200+0000","last_clean":"2024-04-25T13:17:02.811200+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:17:02.811200+0000","last_undegraded":"2024-04-25T13:17:02.811200+0000","last_fullsized":"2024-04-25T13:17:02.811200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507642+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:17:03.507642+0000","last_peered":"2024-04-25T13:17:03.507642+0000","last_clean":"2024-04-25T13:17:03.507642+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:17:03.507642+0000","last_undegraded":"2024-04-25T13:17:03.507642+0000","last_fullsized":"2024-04-25T13:17:03.507642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815381+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:17:02.815381+0000","last_peered":"2024-04-25T13:17:02.815381+0000","last_clean":"2024-04-25T13:17:02.815381+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:17:02.815381+0000","last_undegraded":"2024-04-25T13:17:02.815381+0000","last_fullsized":"2024-04-25T13:17:02.815381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832870+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:17:10.832870+0000","last_peered":"2024-04-25T13:17:10.832870+0000","last_clean":"2024-04-25T13:17:10.832870+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:17:10.832870+0000","last_undegraded":"2024-04-25T13:17:10.832870+0000","last_fullsized":"2024-04-25T13:17:10.832870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507891+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:17:03.507891+0000","last_peered":"2024-04-25T13:17:03.507891+0000","last_clean":"2024-04-25T13:17:03.507891+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:17:03.507891+0000","last_undegraded":"2024-04-25T13:17:03.507891+0000","last_fullsized":"2024-04-25T13:17:03.507891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813293+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:17:02.813293+0000","last_peered":"2024-04-25T13:17:02.813293+0000","last_clean":"2024-04-25T13:17:02.813293+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:17:02.813293+0000","last_undegraded":"2024-04-25T13:17:02.813293+0000","last_fullsized":"2024-04-25T13:17:02.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814681+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:17:04.814681+0000","last_peered":"2024-04-25T13:17:04.814681+0000","last_clean":"2024-04-25T13:17:04.814681+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:17:04.814681+0000","last_undegraded":"2024-04-25T13:17:04.814681+0000","last_fullsized":"2024-04-25T13:17:04.814681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811569+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:17:02.811569+0000","last_peered":"2024-04-25T13:17:02.811569+0000","last_clean":"2024-04-25T13:17:02.811569+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:17:02.811569+0000","last_undegraded":"2024-04-25T13:17:02.811569+0000","last_fullsized":"2024-04-25T13:17:02.811569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814392+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:17:02.814392+0000","last_peered":"2024-04-25T13:17:02.814392+0000","last_clean":"2024-04-25T13:17:02.814392+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:17:02.814392+0000","last_undegraded":"2024-04-25T13:17:02.814392+0000","last_fullsized":"2024-04-25T13:17:02.814392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813543+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:17:04.813543+0000","last_peered":"2024-04-25T13:17:04.813543+0000","last_clean":"2024-04-25T13:17:04.813543+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:17:04.813543+0000","last_undegraded":"2024-04-25T13:17:04.813543+0000","last_fullsized":"2024-04-25T13:17:04.813543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819618+0000","last_change":"2024-04-25T13:17:02.819618+0000","last_active":"2024-04-25T13:17:02.819618+0000","last_peered":"2024-04-25T13:17:02.819618+0000","last_clean":"2024-04-25T13:17:02.819618+0000","last_became_active":"2024-04-25T13:17:02.819016+0000","last_became_peered":"2024-04-25T13:17:02.819016+0000","last_unstale":"2024-04-25T13:17:02.819618+0000","last_undegraded":"2024-04-25T13:17:02.819618+0000","last_fullsized":"2024-04-25T13:17:02.819618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.870384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814175+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:17:02.814175+0000","last_peered":"2024-04-25T13:17:02.814175+0000","last_clean":"2024-04-25T13:17:02.814175+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:17:02.814175+0000","last_undegraded":"2024-04-25T13:17:02.814175+0000","last_fullsized":"2024-04-25T13:17:02.814175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814551+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:17:02.814551+0000","last_peered":"2024-04-25T13:17:02.814551+0000","last_clean":"2024-04-25T13:17:02.814551+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:17:02.814551+0000","last_undegraded":"2024-04-25T13:17:02.814551+0000","last_fullsized":"2024-04-25T13:17:02.814551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813791+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:17:02.813791+0000","last_peered":"2024-04-25T13:17:02.813791+0000","last_clean":"2024-04-25T13:17:02.813791+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:17:02.813791+0000","last_undegraded":"2024-04-25T13:17:02.813791+0000","last_fullsized":"2024-04-25T13:17:02.813791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507846+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:17:03.507846+0000","last_peered":"2024-04-25T13:17:03.507846+0000","last_clean":"2024-04-25T13:17:03.507846+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:17:03.507846+0000","last_undegraded":"2024-04-25T13:17:03.507846+0000","last_fullsized":"2024-04-25T13:17:03.507846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836505+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:17:10.836505+0000","last_peered":"2024-04-25T13:17:10.836505+0000","last_clean":"2024-04-25T13:17:10.836505+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:17:10.836505+0000","last_undegraded":"2024-04-25T13:17:10.836505+0000","last_fullsized":"2024-04-25T13:17:10.836505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510055+0000","last_change":"2024-04-25T13:17:03.509676+0000","last_active":"2024-04-25T13:17:03.510055+0000","last_peered":"2024-04-25T13:17:03.510055+0000","last_clean":"2024-04-25T13:17:03.510055+0000","last_became_active":"2024-04-25T13:17:03.509216+0000","last_became_peered":"2024-04-25T13:17:03.509216+0000","last_unstale":"2024-04-25T13:17:03.510055+0000","last_undegraded":"2024-04-25T13:17:03.510055+0000","last_fullsized":"2024-04-25T13:17:03.510055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:03.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813502+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:17:02.813502+0000","last_peered":"2024-04-25T13:17:02.813502+0000","last_clean":"2024-04-25T13:17:02.813502+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:17:02.813502+0000","last_undegraded":"2024-04-25T13:17:02.813502+0000","last_fullsized":"2024-04-25T13:17:02.813502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832583+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:17:10.832583+0000","last_peered":"2024-04-25T13:17:10.832583+0000","last_clean":"2024-04-25T13:17:10.832583+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:17:10.832583+0000","last_undegraded":"2024-04-25T13:17:10.832583+0000","last_fullsized":"2024-04-25T13:17:10.832583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815038+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:17:02.815038+0000","last_peered":"2024-04-25T13:17:02.815038+0000","last_clean":"2024-04-25T13:17:02.815038+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:17:02.815038+0000","last_undegraded":"2024-04-25T13:17:02.815038+0000","last_fullsized":"2024-04-25T13:17:02.815038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815690+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:17:02.815690+0000","last_peered":"2024-04-25T13:17:02.815690+0000","last_clean":"2024-04-25T13:17:02.815690+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:17:02.815690+0000","last_undegraded":"2024-04-25T13:17:02.815690+0000","last_fullsized":"2024-04-25T13:17:02.815690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811263+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:17:02.811263+0000","last_peered":"2024-04-25T13:17:02.811263+0000","last_clean":"2024-04-25T13:17:02.811263+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:17:02.811263+0000","last_undegraded":"2024-04-25T13:17:02.811263+0000","last_fullsized":"2024-04-25T13:17:02.811263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815166+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:17:02.815166+0000","last_peered":"2024-04-25T13:17:02.815166+0000","last_clean":"2024-04-25T13:17:02.815166+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:17:02.815166+0000","last_undegraded":"2024-04-25T13:17:02.815166+0000","last_fullsized":"2024-04-25T13:17:02.815166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812304+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:17:02.812304+0000","last_peered":"2024-04-25T13:17:02.812304+0000","last_clean":"2024-04-25T13:17:02.812304+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:17:02.812304+0000","last_undegraded":"2024-04-25T13:17:02.812304+0000","last_fullsized":"2024-04-25T13:17:02.812304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813257+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:17:04.813257+0000","last_peered":"2024-04-25T13:17:04.813257+0000","last_clean":"2024-04-25T13:17:04.813257+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:17:04.813257+0000","last_undegraded":"2024-04-25T13:17:04.813257+0000","last_fullsized":"2024-04-25T13:17:04.813257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811317+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:17:02.811317+0000","last_peered":"2024-04-25T13:17:02.811317+0000","last_clean":"2024-04-25T13:17:02.811317+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:17:02.811317+0000","last_undegraded":"2024-04-25T13:17:02.811317+0000","last_fullsized":"2024-04-25T13:17:02.811317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508569+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:17:03.508569+0000","last_peered":"2024-04-25T13:17:03.508569+0000","last_clean":"2024-04-25T13:17:03.508569+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:17:03.508569+0000","last_undegraded":"2024-04-25T13:17:03.508569+0000","last_fullsized":"2024-04-25T13:17:03.508569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811924+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:17:02.811924+0000","last_peered":"2024-04-25T13:17:02.811924+0000","last_clean":"2024-04-25T13:17:02.811924+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:17:02.811924+0000","last_undegraded":"2024-04-25T13:17:02.811924+0000","last_fullsized":"2024-04-25T13:17:02.811924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.113778+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:17:19.113778+0000","last_peered":"2024-04-25T13:17:19.113778+0000","last_clean":"2024-04-25T13:17:19.113778+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:17:19.113778+0000","last_undegraded":"2024-04-25T13:17:19.113778+0000","last_fullsized":"2024-04-25T13:17:19.113778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507938+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:17:03.507938+0000","last_peered":"2024-04-25T13:17:03.507938+0000","last_clean":"2024-04-25T13:17:03.507938+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:17:03.507938+0000","last_undegraded":"2024-04-25T13:17:03.507938+0000","last_fullsized":"2024-04-25T13:17:03.507938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814058+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:17:02.814058+0000","last_peered":"2024-04-25T13:17:02.814058+0000","last_clean":"2024-04-25T13:17:02.814058+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:17:02.814058+0000","last_undegraded":"2024-04-25T13:17:02.814058+0000","last_fullsized":"2024-04-25T13:17:02.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.808777+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:17:04.808777+0000","last_peered":"2024-04-25T13:17:04.808777+0000","last_clean":"2024-04-25T13:17:04.808777+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:17:04.808777+0000","last_undegraded":"2024-04-25T13:17:04.808777+0000","last_fullsized":"2024-04-25T13:17:04.808777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816191+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:17:02.816191+0000","last_peered":"2024-04-25T13:17:02.816191+0000","last_clean":"2024-04-25T13:17:02.816191+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:17:02.816191+0000","last_undegraded":"2024-04-25T13:17:02.816191+0000","last_fullsized":"2024-04-25T13:17:02.816191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812288+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:17:02.812288+0000","last_peered":"2024-04-25T13:17:02.812288+0000","last_clean":"2024-04-25T13:17:02.812288+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:17:02.812288+0000","last_undegraded":"2024-04-25T13:17:02.812288+0000","last_fullsized":"2024-04-25T13:17:02.812288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835384+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:17:10.835384+0000","last_peered":"2024-04-25T13:17:10.835384+0000","last_clean":"2024-04-25T13:17:10.835384+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:17:10.835384+0000","last_undegraded":"2024-04-25T13:17:10.835384+0000","last_fullsized":"2024-04-25T13:17:10.835384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813046+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:17:02.813046+0000","last_peered":"2024-04-25T13:17:02.813046+0000","last_clean":"2024-04-25T13:17:02.813046+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:17:02.813046+0000","last_undegraded":"2024-04-25T13:17:02.813046+0000","last_fullsized":"2024-04-25T13:17:02.813046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811950+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:17:02.811950+0000","last_peered":"2024-04-25T13:17:02.811950+0000","last_clean":"2024-04-25T13:17:02.811950+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:17:02.811950+0000","last_undegraded":"2024-04-25T13:17:02.811950+0000","last_fullsized":"2024-04-25T13:17:02.811950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507795+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:17:03.507795+0000","last_peered":"2024-04-25T13:17:03.507795+0000","last_clean":"2024-04-25T13:17:03.507795+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:17:03.507795+0000","last_undegraded":"2024-04-25T13:17:03.507795+0000","last_fullsized":"2024-04-25T13:17:03.507795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507210+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:17:03.507210+0000","last_peered":"2024-04-25T13:17:03.507210+0000","last_clean":"2024-04-25T13:17:03.507210+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:17:03.507210+0000","last_undegraded":"2024-04-25T13:17:03.507210+0000","last_fullsized":"2024-04-25T13:17:03.507210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811434+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:17:02.811434+0000","last_peered":"2024-04-25T13:17:02.811434+0000","last_clean":"2024-04-25T13:17:02.811434+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:17:02.811434+0000","last_undegraded":"2024-04-25T13:17:02.811434+0000","last_fullsized":"2024-04-25T13:17:02.811434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.810341+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:17:04.810341+0000","last_peered":"2024-04-25T13:17:04.810341+0000","last_clean":"2024-04-25T13:17:04.810341+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:17:04.810341+0000","last_undegraded":"2024-04-25T13:17:04.810341+0000","last_fullsized":"2024-04-25T13:17:04.810341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814520+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:17:02.814520+0000","last_peered":"2024-04-25T13:17:02.814520+0000","last_clean":"2024-04-25T13:17:02.814520+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:17:02.814520+0000","last_undegraded":"2024-04-25T13:17:02.814520+0000","last_fullsized":"2024-04-25T13:17:02.814520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508154+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:17:03.508154+0000","last_peered":"2024-04-25T13:17:03.508154+0000","last_clean":"2024-04-25T13:17:03.508154+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:17:03.508154+0000","last_undegraded":"2024-04-25T13:17:03.508154+0000","last_fullsized":"2024-04-25T13:17:03.508154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.121264+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:17:19.121264+0000","last_peered":"2024-04-25T13:17:19.121264+0000","last_clean":"2024-04-25T13:17:19.121264+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:17:19.121264+0000","last_undegraded":"2024-04-25T13:17:19.121264+0000","last_fullsized":"2024-04-25T13:17:19.121264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812765+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:17:02.812765+0000","last_peered":"2024-04-25T13:17:02.812765+0000","last_clean":"2024-04-25T13:17:02.812765+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:17:02.812765+0000","last_undegraded":"2024-04-25T13:17:02.812765+0000","last_fullsized":"2024-04-25T13:17:02.812765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811663+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:17:02.811663+0000","last_peered":"2024-04-25T13:17:02.811663+0000","last_clean":"2024-04-25T13:17:02.811663+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:17:02.811663+0000","last_undegraded":"2024-04-25T13:17:02.811663+0000","last_fullsized":"2024-04-25T13:17:02.811663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813445+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:17:04.813445+0000","last_peered":"2024-04-25T13:17:04.813445+0000","last_clean":"2024-04-25T13:17:04.813445+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:17:04.813445+0000","last_undegraded":"2024-04-25T13:17:04.813445+0000","last_fullsized":"2024-04-25T13:17:04.813445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.818420+0000","last_change":"2024-04-25T13:17:02.818420+0000","last_active":"2024-04-25T13:17:02.818420+0000","last_peered":"2024-04-25T13:17:02.818420+0000","last_clean":"2024-04-25T13:17:02.818420+0000","last_became_active":"2024-04-25T13:17:02.817864+0000","last_became_peered":"2024-04-25T13:17:02.817864+0000","last_unstale":"2024-04-25T13:17:02.818420+0000","last_undegraded":"2024-04-25T13:17:02.818420+0000","last_fullsized":"2024-04-25T13:17:02.818420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:52.960881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815996+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:17:02.815996+0000","last_peered":"2024-04-25T13:17:02.815996+0000","last_clean":"2024-04-25T13:17:02.815996+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:17:02.815996+0000","last_undegraded":"2024-04-25T13:17:02.815996+0000","last_fullsized":"2024-04-25T13:17:02.815996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836070+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:17:10.836070+0000","last_peered":"2024-04-25T13:17:10.836070+0000","last_clean":"2024-04-25T13:17:10.836070+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:17:10.836070+0000","last_undegraded":"2024-04-25T13:17:10.836070+0000","last_fullsized":"2024-04-25T13:17:10.836070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813967+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:17:02.813967+0000","last_peered":"2024-04-25T13:17:02.813967+0000","last_clean":"2024-04-25T13:17:02.813967+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:17:02.813967+0000","last_undegraded":"2024-04-25T13:17:02.813967+0000","last_fullsized":"2024-04-25T13:17:02.813967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811857+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:17:02.811857+0000","last_peered":"2024-04-25T13:17:02.811857+0000","last_clean":"2024-04-25T13:17:02.811857+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:17:02.811857+0000","last_undegraded":"2024-04-25T13:17:02.811857+0000","last_fullsized":"2024-04-25T13:17:02.811857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.123871+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:17:19.123871+0000","last_peered":"2024-04-25T13:17:19.123871+0000","last_clean":"2024-04-25T13:17:19.123871+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:17:19.123871+0000","last_undegraded":"2024-04-25T13:17:19.123871+0000","last_fullsized":"2024-04-25T13:17:19.123871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813833+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:17:02.813833+0000","last_peered":"2024-04-25T13:17:02.813833+0000","last_clean":"2024-04-25T13:17:02.813833+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:17:02.813833+0000","last_undegraded":"2024-04-25T13:17:02.813833+0000","last_fullsized":"2024-04-25T13:17:02.813833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507633+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:17:03.507633+0000","last_peered":"2024-04-25T13:17:03.507633+0000","last_clean":"2024-04-25T13:17:03.507633+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:17:03.507633+0000","last_undegraded":"2024-04-25T13:17:03.507633+0000","last_fullsized":"2024-04-25T13:17:03.507633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815428+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:17:02.815428+0000","last_peered":"2024-04-25T13:17:02.815428+0000","last_clean":"2024-04-25T13:17:02.815428+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:17:02.815428+0000","last_undegraded":"2024-04-25T13:17:02.815428+0000","last_fullsized":"2024-04-25T13:17:02.815428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507401+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:17:03.507401+0000","last_peered":"2024-04-25T13:17:03.507401+0000","last_clean":"2024-04-25T13:17:03.507401+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:17:03.507401+0000","last_undegraded":"2024-04-25T13:17:03.507401+0000","last_fullsized":"2024-04-25T13:17:03.507401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814768+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:17:02.814768+0000","last_peered":"2024-04-25T13:17:02.814768+0000","last_clean":"2024-04-25T13:17:02.814768+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:17:02.814768+0000","last_undegraded":"2024-04-25T13:17:02.814768+0000","last_fullsized":"2024-04-25T13:17:02.814768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836480+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:17:10.836480+0000","last_peered":"2024-04-25T13:17:10.836480+0000","last_clean":"2024-04-25T13:17:10.836480+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:17:10.836480+0000","last_undegraded":"2024-04-25T13:17:10.836480+0000","last_fullsized":"2024-04-25T13:17:10.836480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811722+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:17:02.811722+0000","last_peered":"2024-04-25T13:17:02.811722+0000","last_clean":"2024-04-25T13:17:02.811722+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:17:02.811722+0000","last_undegraded":"2024-04-25T13:17:02.811722+0000","last_fullsized":"2024-04-25T13:17:02.811722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819428+0000","last_change":"2024-04-25T13:17:02.817603+0000","last_active":"2024-04-25T13:17:02.819428+0000","last_peered":"2024-04-25T13:17:02.819428+0000","last_clean":"2024-04-25T13:17:02.819428+0000","last_became_active":"2024-04-25T13:17:02.817270+0000","last_became_peered":"2024-04-25T13:17:02.817270+0000","last_unstale":"2024-04-25T13:17:02.819428+0000","last_undegraded":"2024-04-25T13:17:02.819428+0000","last_fullsized":"2024-04-25T13:17:02.819428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:29.177195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118727+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:17:19.118727+0000","last_peered":"2024-04-25T13:17:19.118727+0000","last_clean":"2024-04-25T13:17:19.118727+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:17:19.118727+0000","last_undegraded":"2024-04-25T13:17:19.118727+0000","last_fullsized":"2024-04-25T13:17:19.118727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811958+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:17:02.811958+0000","last_peered":"2024-04-25T13:17:02.811958+0000","last_clean":"2024-04-25T13:17:02.811958+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:17:02.811958+0000","last_undegraded":"2024-04-25T13:17:02.811958+0000","last_fullsized":"2024-04-25T13:17:02.811958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814326+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:17:02.814326+0000","last_peered":"2024-04-25T13:17:02.814326+0000","last_clean":"2024-04-25T13:17:02.814326+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:17:02.814326+0000","last_undegraded":"2024-04-25T13:17:02.814326+0000","last_fullsized":"2024-04-25T13:17:02.814326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813605+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:17:02.813605+0000","last_peered":"2024-04-25T13:17:02.813605+0000","last_clean":"2024-04-25T13:17:02.813605+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:17:02.813605+0000","last_undegraded":"2024-04-25T13:17:02.813605+0000","last_fullsized":"2024-04-25T13:17:02.813605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814202+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:17:04.814202+0000","last_peered":"2024-04-25T13:17:04.814202+0000","last_clean":"2024-04-25T13:17:04.814202+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:17:04.814202+0000","last_undegraded":"2024-04-25T13:17:04.814202+0000","last_fullsized":"2024-04-25T13:17:04.814202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508256+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:17:03.508256+0000","last_peered":"2024-04-25T13:17:03.508256+0000","last_clean":"2024-04-25T13:17:03.508256+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:17:03.508256+0000","last_undegraded":"2024-04-25T13:17:03.508256+0000","last_fullsized":"2024-04-25T13:17:03.508256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811828+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:17:02.811828+0000","last_peered":"2024-04-25T13:17:02.811828+0000","last_clean":"2024-04-25T13:17:02.811828+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:17:02.811828+0000","last_undegraded":"2024-04-25T13:17:02.811828+0000","last_fullsized":"2024-04-25T13:17:02.811828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814084+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:17:02.814084+0000","last_peered":"2024-04-25T13:17:02.814084+0000","last_clean":"2024-04-25T13:17:02.814084+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:17:02.814084+0000","last_undegraded":"2024-04-25T13:17:02.814084+0000","last_fullsized":"2024-04-25T13:17:02.814084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814176+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:17:04.814176+0000","last_peered":"2024-04-25T13:17:04.814176+0000","last_clean":"2024-04-25T13:17:04.814176+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:17:04.814176+0000","last_undegraded":"2024-04-25T13:17:04.814176+0000","last_fullsized":"2024-04-25T13:17:04.814176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816379+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:17:02.816379+0000","last_peered":"2024-04-25T13:17:02.816379+0000","last_clean":"2024-04-25T13:17:02.816379+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:17:02.816379+0000","last_undegraded":"2024-04-25T13:17:02.816379+0000","last_fullsized":"2024-04-25T13:17:02.816379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815681+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:17:02.815681+0000","last_peered":"2024-04-25T13:17:02.815681+0000","last_clean":"2024-04-25T13:17:02.815681+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:17:02.815681+0000","last_undegraded":"2024-04-25T13:17:02.815681+0000","last_fullsized":"2024-04-25T13:17:02.815681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118875+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:17:19.118875+0000","last_peered":"2024-04-25T13:17:19.118875+0000","last_clean":"2024-04-25T13:17:19.118875+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:17:19.118875+0000","last_undegraded":"2024-04-25T13:17:19.118875+0000","last_fullsized":"2024-04-25T13:17:19.118875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507498+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:17:03.507498+0000","last_peered":"2024-04-25T13:17:03.507498+0000","last_clean":"2024-04-25T13:17:03.507498+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:17:03.507498+0000","last_undegraded":"2024-04-25T13:17:03.507498+0000","last_fullsized":"2024-04-25T13:17:03.507498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812540+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:17:02.812540+0000","last_peered":"2024-04-25T13:17:02.812540+0000","last_clean":"2024-04-25T13:17:02.812540+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:17:02.812540+0000","last_undegraded":"2024-04-25T13:17:02.812540+0000","last_fullsized":"2024-04-25T13:17:02.812540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508013+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:17:03.508013+0000","last_peered":"2024-04-25T13:17:03.508013+0000","last_clean":"2024-04-25T13:17:03.508013+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:17:03.508013+0000","last_undegraded":"2024-04-25T13:17:03.508013+0000","last_fullsized":"2024-04-25T13:17:03.508013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815859+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:17:02.815859+0000","last_peered":"2024-04-25T13:17:02.815859+0000","last_clean":"2024-04-25T13:17:02.815859+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:17:02.815859+0000","last_undegraded":"2024-04-25T13:17:02.815859+0000","last_fullsized":"2024-04-25T13:17:02.815859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813541+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:17:02.813541+0000","last_peered":"2024-04-25T13:17:02.813541+0000","last_clean":"2024-04-25T13:17:02.813541+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:17:02.813541+0000","last_undegraded":"2024-04-25T13:17:02.813541+0000","last_fullsized":"2024-04-25T13:17:02.813541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816291+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:17:02.816291+0000","last_peered":"2024-04-25T13:17:02.816291+0000","last_clean":"2024-04-25T13:17:02.816291+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:17:02.816291+0000","last_undegraded":"2024-04-25T13:17:02.816291+0000","last_fullsized":"2024-04-25T13:17:02.816291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812966+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:17:02.812966+0000","last_peered":"2024-04-25T13:17:02.812966+0000","last_clean":"2024-04-25T13:17:02.812966+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:17:02.812966+0000","last_undegraded":"2024-04-25T13:17:02.812966+0000","last_fullsized":"2024-04-25T13:17:02.812966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815198+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:17:02.815198+0000","last_peered":"2024-04-25T13:17:02.815198+0000","last_clean":"2024-04-25T13:17:02.815198+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:17:02.815198+0000","last_undegraded":"2024-04-25T13:17:02.815198+0000","last_fullsized":"2024-04-25T13:17:02.815198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508661+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:17:03.508661+0000","last_peered":"2024-04-25T13:17:03.508661+0000","last_clean":"2024-04-25T13:17:03.508661+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:17:03.508661+0000","last_undegraded":"2024-04-25T13:17:03.508661+0000","last_fullsized":"2024-04-25T13:17:03.508661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812859+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:17:02.812859+0000","last_peered":"2024-04-25T13:17:02.812859+0000","last_clean":"2024-04-25T13:17:02.812859+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:17:02.812859+0000","last_undegraded":"2024-04-25T13:17:02.812859+0000","last_fullsized":"2024-04-25T13:17:02.812859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813154+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:17:02.813154+0000","last_peered":"2024-04-25T13:17:02.813154+0000","last_clean":"2024-04-25T13:17:02.813154+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:17:02.813154+0000","last_undegraded":"2024-04-25T13:17:02.813154+0000","last_fullsized":"2024-04-25T13:17:02.813154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812212+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:17:02.812212+0000","last_peered":"2024-04-25T13:17:02.812212+0000","last_clean":"2024-04-25T13:17:02.812212+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:17:02.812212+0000","last_undegraded":"2024-04-25T13:17:02.812212+0000","last_fullsized":"2024-04-25T13:17:02.812212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813496+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:17:02.813496+0000","last_peered":"2024-04-25T13:17:02.813496+0000","last_clean":"2024-04-25T13:17:02.813496+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:17:02.813496+0000","last_undegraded":"2024-04-25T13:17:02.813496+0000","last_fullsized":"2024-04-25T13:17:02.813496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816090+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:17:02.816090+0000","last_peered":"2024-04-25T13:17:02.816090+0000","last_clean":"2024-04-25T13:17:02.816090+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:17:02.816090+0000","last_undegraded":"2024-04-25T13:17:02.816090+0000","last_fullsized":"2024-04-25T13:17:02.816090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508097+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:17:03.508097+0000","last_peered":"2024-04-25T13:17:03.508097+0000","last_clean":"2024-04-25T13:17:03.508097+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:17:03.508097+0000","last_undegraded":"2024-04-25T13:17:03.508097+0000","last_fullsized":"2024-04-25T13:17:03.508097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812095+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:17:02.812095+0000","last_peered":"2024-04-25T13:17:02.812095+0000","last_clean":"2024-04-25T13:17:02.812095+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:17:02.812095+0000","last_undegraded":"2024-04-25T13:17:02.812095+0000","last_fullsized":"2024-04-25T13:17:02.812095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816774+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:17:02.816774+0000","last_peered":"2024-04-25T13:17:02.816774+0000","last_clean":"2024-04-25T13:17:02.816774+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.816774+0000","last_undegraded":"2024-04-25T13:17:02.816774+0000","last_fullsized":"2024-04-25T13:17:02.816774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819531+0000","last_change":"2024-04-25T13:17:02.818074+0000","last_active":"2024-04-25T13:17:02.819531+0000","last_peered":"2024-04-25T13:17:02.819531+0000","last_clean":"2024-04-25T13:17:02.819531+0000","last_became_active":"2024-04-25T13:17:02.817489+0000","last_became_peered":"2024-04-25T13:17:02.817489+0000","last_unstale":"2024-04-25T13:17:02.819531+0000","last_undegraded":"2024-04-25T13:17:02.819531+0000","last_fullsized":"2024-04-25T13:17:02.819531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:24.336162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813129+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:17:02.813129+0000","last_peered":"2024-04-25T13:17:02.813129+0000","last_clean":"2024-04-25T13:17:02.813129+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:17:02.813129+0000","last_undegraded":"2024-04-25T13:17:02.813129+0000","last_fullsized":"2024-04-25T13:17:02.813129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813390+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:17:02.813390+0000","last_peered":"2024-04-25T13:17:02.813390+0000","last_clean":"2024-04-25T13:17:02.813390+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:17:02.813390+0000","last_undegraded":"2024-04-25T13:17:02.813390+0000","last_fullsized":"2024-04-25T13:17:02.813390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815900+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:17:02.815900+0000","last_peered":"2024-04-25T13:17:02.815900+0000","last_clean":"2024-04-25T13:17:02.815900+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:17:02.815900+0000","last_undegraded":"2024-04-25T13:17:02.815900+0000","last_fullsized":"2024-04-25T13:17:02.815900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811962+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:17:02.811962+0000","last_peered":"2024-04-25T13:17:02.811962+0000","last_clean":"2024-04-25T13:17:02.811962+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.811962+0000","last_undegraded":"2024-04-25T13:17:02.811962+0000","last_fullsized":"2024-04-25T13:17:02.811962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507772+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:17:03.507772+0000","last_peered":"2024-04-25T13:17:03.507772+0000","last_clean":"2024-04-25T13:17:03.507772+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:17:03.507772+0000","last_undegraded":"2024-04-25T13:17:03.507772+0000","last_fullsized":"2024-04-25T13:17:03.507772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508579+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:17:03.508579+0000","last_peered":"2024-04-25T13:17:03.508579+0000","last_clean":"2024-04-25T13:17:03.508579+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:17:03.508579+0000","last_undegraded":"2024-04-25T13:17:03.508579+0000","last_fullsized":"2024-04-25T13:17:03.508579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508564+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:17:03.508564+0000","last_peered":"2024-04-25T13:17:03.508564+0000","last_clean":"2024-04-25T13:17:03.508564+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:17:03.508564+0000","last_undegraded":"2024-04-25T13:17:03.508564+0000","last_fullsized":"2024-04-25T13:17:03.508564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.823907+0000","last_change":"2024-04-25T13:17:02.819234+0000","last_active":"2024-04-25T13:17:02.823907+0000","last_peered":"2024-04-25T13:17:02.823907+0000","last_clean":"2024-04-25T13:17:02.823907+0000","last_became_active":"2024-04-25T13:17:02.818740+0000","last_became_peered":"2024-04-25T13:17:02.818740+0000","last_unstale":"2024-04-25T13:17:02.823907+0000","last_undegraded":"2024-04-25T13:17:02.823907+0000","last_fullsized":"2024-04-25T13:17:02.823907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.255803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811710+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:17:02.811710+0000","last_peered":"2024-04-25T13:17:02.811710+0000","last_clean":"2024-04-25T13:17:02.811710+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:17:02.811710+0000","last_undegraded":"2024-04-25T13:17:02.811710+0000","last_fullsized":"2024-04-25T13:17:02.811710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811344+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:17:02.811344+0000","last_peered":"2024-04-25T13:17:02.811344+0000","last_clean":"2024-04-25T13:17:02.811344+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:17:02.811344+0000","last_undegraded":"2024-04-25T13:17:02.811344+0000","last_fullsized":"2024-04-25T13:17:02.811344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813459+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:17:02.813459+0000","last_peered":"2024-04-25T13:17:02.813459+0000","last_clean":"2024-04-25T13:17:02.813459+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:17:02.813459+0000","last_undegraded":"2024-04-25T13:17:02.813459+0000","last_fullsized":"2024-04-25T13:17:02.813459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811565+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:17:02.811565+0000","last_peered":"2024-04-25T13:17:02.811565+0000","last_clean":"2024-04-25T13:17:02.811565+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:17:02.811565+0000","last_undegraded":"2024-04-25T13:17:02.811565+0000","last_fullsized":"2024-04-25T13:17:02.811565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813964+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:17:02.813964+0000","last_peered":"2024-04-25T13:17:02.813964+0000","last_clean":"2024-04-25T13:17:02.813964+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:17:02.813964+0000","last_undegraded":"2024-04-25T13:17:02.813964+0000","last_fullsized":"2024-04-25T13:17:02.813964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814995+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:17:02.814995+0000","last_peered":"2024-04-25T13:17:02.814995+0000","last_clean":"2024-04-25T13:17:02.814995+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:17:02.814995+0000","last_undegraded":"2024-04-25T13:17:02.814995+0000","last_fullsized":"2024-04-25T13:17:02.814995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815920+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:17:02.815920+0000","last_peered":"2024-04-25T13:17:02.815920+0000","last_clean":"2024-04-25T13:17:02.815920+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:17:02.815920+0000","last_undegraded":"2024-04-25T13:17:02.815920+0000","last_fullsized":"2024-04-25T13:17:02.815920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812114+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:17:02.812114+0000","last_peered":"2024-04-25T13:17:02.812114+0000","last_clean":"2024-04-25T13:17:02.812114+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:17:02.812114+0000","last_undegraded":"2024-04-25T13:17:02.812114+0000","last_fullsized":"2024-04-25T13:17:02.812114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":123554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":120952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":124870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":121084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":710282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:30.558 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:17:30.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:30.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.690+0000 7f10afe42640 1 Processor -- start 2024-04-25T13:17:30.691 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.690+0000 7f10afe42640 1 -- start start 2024-04-25T13:17:30.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10afe42640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f10a806bf70 0x7f10a815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10afe42640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10a80c99f0 0x7f10a80c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10afe42640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a815bef0 con 0x7f10a806bb90 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10afe42640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f10a815f510 con 0x7f10a80c99f0 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10afe42640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f10a815b650 con 0x7f10a806bf70 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10a80c99f0 0x7f10a80c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f10a80c99f0 0x7f10a80c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58732/0 (socket says 172.21.15.155:58732) 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 -- 172.21.15.155:0/4279571178 learned_addr learned my addr 172.21.15.155:0/4279571178 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:30.693 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ad3dd640 1 --2- 172.21.15.155:0/4279571178 >> v2:172.21.15.191:3300/0 conn(0x7f10a806bf70 0x7f10a815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 -- 172.21.15.155:0/4279571178 >> v2:172.21.15.191:3300/0 conn(0x7f10a806bf70 msgr2=0x7f10a815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:30.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 --2- 172.21.15.155:0/4279571178 >> v2:172.21.15.191:3300/0 conn(0x7f10a806bf70 0x7f10a815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 -- 172.21.15.155:0/4279571178 >> v1:172.21.15.191:6789/0 conn(0x7f10a806bb90 legacy=0x7f10a815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:30.694 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.691+0000 7f10ae3df640 1 -- 172.21.15.155:0/4279571178 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a815b930 con 0x7f10a80c99f0 2024-04-25T13:17:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.692+0000 7f10ae3df640 1 --2- 172.21.15.155:0/4279571178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a80c99f0 0x7f10a80c9e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10a806c460 tx=0x7f10a002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590220e1d172893a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.692+0000 7f10acbdc640 1 -- 172.21.15.155:0/4279571178 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0036070 con 0x7f10a80c99f0 2024-04-25T13:17:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.692+0000 7f10acbdc640 1 -- 172.21.15.155:0/4279571178 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a0031600 con 0x7f10a80c99f0 2024-04-25T13:17:30.698 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.692+0000 7f10acbdc640 1 -- 172.21.15.155:0/4279571178 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00319d0 con 0x7f10a80c99f0 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 -- 172.21.15.155:0/4279571178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a80c99f0 msgr2=0x7f10a80c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 --2- 172.21.15.155:0/4279571178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a80c99f0 0x7f10a80c9e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f10a806c460 tx=0x7f10a002a780 comp rx=0 tx=0).stop 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 -- 172.21.15.155:0/4279571178 shutdown_connections 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 --2- 172.21.15.155:0/4279571178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a80c99f0 0x7f10a80c9e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 --2- 172.21.15.155:0/4279571178 >> v2:172.21.15.191:3300/0 conn(0x7f10a806bf70 0x7f10a815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 -- 172.21.15.155:0/4279571178 >> 172.21.15.155:0/4279571178 conn(0x7f10a8074d50 msgr2=0x7f10a8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 -- 172.21.15.155:0/4279571178 shutdown_connections 2024-04-25T13:17:30.699 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.693+0000 7f10afe42640 1 -- 172.21.15.155:0/4279571178 wait complete. 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.694+0000 7f10afe42640 1 Processor -- start 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.694+0000 7f10afe42640 1 -- start start 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10a806bb90 0x7f10a80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 0x7f10a815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10a80c99f0 0x7f10a81f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10a815e8e0 con 0x7f10a806bf70 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f10a815e600 con 0x7f10a80c99f0 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f10a8074560 con 0x7f10a806bb90 2024-04-25T13:17:30.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 0x7f10a815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 0x7f10a815ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58740/0 (socket says 172.21.15.155:58740) 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 -- 172.21.15.155:0/1641590872 learned_addr learned my addr 172.21.15.155:0/1641590872 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 -- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10a806bb90 msgr2=0x7f10a80ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ae3df640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10a80c99f0 0x7f10a81f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10adbde640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10a806bb90 0x7f10a80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10a806bb90 0x7f10a80ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 -- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10a80c99f0 msgr2=0x7f10a81f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10a80c99f0 0x7f10a81f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.701 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 -- 172.21.15.155:0/1641590872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a814db20 con 0x7f10a806bf70 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ae3df640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10a80c99f0 0x7f10a81f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10adbde640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10a806bb90 0x7f10a80ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10ad3dd640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 0x7f10a815ab50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f109800d5c0 tx=0x7f109800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10980125f0 con 0x7f10a806bf70 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098019070 con 0x7f10a806bf70 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a814de00 con 0x7f10a806bf70 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10980129d0 con 0x7f10a806bf70 2024-04-25T13:17:30.702 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.695+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a814e3c0 con 0x7f10a806bf70 2024-04-25T13:17:30.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.696+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a8069e50 con 0x7f10a806bf70 2024-04-25T13:17:30.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.697+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1098012b70 con 0x7f10a806bf70 2024-04-25T13:17:30.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.697+0000 7f109e7fc640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f108c06c8f0 0x7f108c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:30.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.697+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f109808c390 con 0x7f10a806bf70 2024-04-25T13:17:30.703 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.697+0000 7f10adbde640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f108c06c8f0 0x7f108c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:30.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.698+0000 7f10adbde640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f108c06c8f0 0x7f108c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10a400a830 tx=0x7f10a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:30.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.702+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10a8069e50 con 0x7f10a806bf70 2024-04-25T13:17:30.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.879+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10a8068e40 con 0x7f108c06c8f0 2024-04-25T13:17:30.888 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.887+0000 7f109e7fc640 1 -- 172.21.15.155:0/1641590872 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f10a8068e40 con 0x7f108c06c8f0 2024-04-25T13:17:30.891 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:30.893 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f108c06c8f0 msgr2=0x7f108c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f108c06c8f0 0x7f108c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10a400a830 tx=0x7f10a4008040 comp rx=0 tx=0).stop 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 msgr2=0x7f10a815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 0x7f10a815ab50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f109800d5c0 tx=0x7f109800da80 comp rx=0 tx=0).stop 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 shutdown_connections 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f10a80c99f0 0x7f10a81f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a806bf70 0x7f10a815ab50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f108c06c8f0 0x7f108c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 --2- 172.21.15.155:0/1641590872 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f10a806bb90 0x7f10a80ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.890+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 >> 172.21.15.155:0/1641590872 conn(0x7f10a8074d50 msgr2=0x7f10a8153300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.891+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 shutdown_connections 2024-04-25T13:17:30.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:30.891+0000 7f10afe42640 1 -- 172.21.15.155:0/1641590872 wait complete. 2024-04-25T13:17:30.902 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T13:17:29.632074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219816,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754904,"statfs":{"total":773094113280,"available":772869021696,"internally_reserved":0,"allocated":3776512,"data_stored":2158240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002339"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835797+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:17:10.835797+0000","last_peered":"2024-04-25T13:17:10.835797+0000","last_clean":"2024-04-25T13:17:10.835797+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:17:10.835797+0000","last_undegraded":"2024-04-25T13:17:10.835797+0000","last_fullsized":"2024-04-25T13:17:10.835797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:02.016393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510369+0000","last_change":"2024-04-25T13:17:03.509734+0000","last_active":"2024-04-25T13:17:03.510369+0000","last_peered":"2024-04-25T13:17:03.510369+0000","last_clean":"2024-04-25T13:17:03.510369+0000","last_became_active":"2024-04-25T13:17:03.509296+0000","last_became_peered":"2024-04-25T13:17:03.509296+0000","last_unstale":"2024-04-25T13:17:03.510369+0000","last_undegraded":"2024-04-25T13:17:03.510369+0000","last_fullsized":"2024-04-25T13:17:03.510369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:40.776398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811834+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:17:02.811834+0000","last_peered":"2024-04-25T13:17:02.811834+0000","last_clean":"2024-04-25T13:17:02.811834+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:17:02.811834+0000","last_undegraded":"2024-04-25T13:17:02.811834+0000","last_fullsized":"2024-04-25T13:17:02.811834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812634+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:17:02.812634+0000","last_peered":"2024-04-25T13:17:02.812634+0000","last_clean":"2024-04-25T13:17:02.812634+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:17:02.812634+0000","last_undegraded":"2024-04-25T13:17:02.812634+0000","last_fullsized":"2024-04-25T13:17:02.812634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814541+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:17:02.814541+0000","last_peered":"2024-04-25T13:17:02.814541+0000","last_clean":"2024-04-25T13:17:02.814541+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:17:02.814541+0000","last_undegraded":"2024-04-25T13:17:02.814541+0000","last_fullsized":"2024-04-25T13:17:02.814541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:29.695505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507295+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:17:03.507295+0000","last_peered":"2024-04-25T13:17:03.507295+0000","last_clean":"2024-04-25T13:17:03.507295+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:17:03.507295+0000","last_undegraded":"2024-04-25T13:17:03.507295+0000","last_fullsized":"2024-04-25T13:17:03.507295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836728+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:17:10.836728+0000","last_peered":"2024-04-25T13:17:10.836728+0000","last_clean":"2024-04-25T13:17:10.836728+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:17:10.836728+0000","last_undegraded":"2024-04-25T13:17:10.836728+0000","last_fullsized":"2024-04-25T13:17:10.836728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814019+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:17:02.814019+0000","last_peered":"2024-04-25T13:17:02.814019+0000","last_clean":"2024-04-25T13:17:02.814019+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:17:02.814019+0000","last_undegraded":"2024-04-25T13:17:02.814019+0000","last_fullsized":"2024-04-25T13:17:02.814019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507708+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:17:03.507708+0000","last_peered":"2024-04-25T13:17:03.507708+0000","last_clean":"2024-04-25T13:17:03.507708+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:17:03.507708+0000","last_undegraded":"2024-04-25T13:17:03.507708+0000","last_fullsized":"2024-04-25T13:17:03.507708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836368+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:17:10.836368+0000","last_peered":"2024-04-25T13:17:10.836368+0000","last_clean":"2024-04-25T13:17:10.836368+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:17:10.836368+0000","last_undegraded":"2024-04-25T13:17:10.836368+0000","last_fullsized":"2024-04-25T13:17:10.836368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814079+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:17:02.814079+0000","last_peered":"2024-04-25T13:17:02.814079+0000","last_clean":"2024-04-25T13:17:02.814079+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:17:02.814079+0000","last_undegraded":"2024-04-25T13:17:02.814079+0000","last_fullsized":"2024-04-25T13:17:02.814079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507393+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:17:03.507393+0000","last_peered":"2024-04-25T13:17:03.507393+0000","last_clean":"2024-04-25T13:17:03.507393+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:17:03.507393+0000","last_undegraded":"2024-04-25T13:17:03.507393+0000","last_fullsized":"2024-04-25T13:17:03.507393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507939+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:17:03.507939+0000","last_peered":"2024-04-25T13:17:03.507939+0000","last_clean":"2024-04-25T13:17:03.507939+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:17:03.507939+0000","last_undegraded":"2024-04-25T13:17:03.507939+0000","last_fullsized":"2024-04-25T13:17:03.507939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811751+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:17:02.811751+0000","last_peered":"2024-04-25T13:17:02.811751+0000","last_clean":"2024-04-25T13:17:02.811751+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:17:02.811751+0000","last_undegraded":"2024-04-25T13:17:02.811751+0000","last_fullsized":"2024-04-25T13:17:02.811751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507691+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:17:03.507691+0000","last_peered":"2024-04-25T13:17:03.507691+0000","last_clean":"2024-04-25T13:17:03.507691+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:17:03.507691+0000","last_undegraded":"2024-04-25T13:17:03.507691+0000","last_fullsized":"2024-04-25T13:17:03.507691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812072+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:17:02.812072+0000","last_peered":"2024-04-25T13:17:02.812072+0000","last_clean":"2024-04-25T13:17:02.812072+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:17:02.812072+0000","last_undegraded":"2024-04-25T13:17:02.812072+0000","last_fullsized":"2024-04-25T13:17:02.812072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813464+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:17:04.813464+0000","last_peered":"2024-04-25T13:17:04.813464+0000","last_clean":"2024-04-25T13:17:04.813464+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:17:04.813464+0000","last_undegraded":"2024-04-25T13:17:04.813464+0000","last_fullsized":"2024-04-25T13:17:04.813464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:22.582097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507510+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:17:03.507510+0000","last_peered":"2024-04-25T13:17:03.507510+0000","last_clean":"2024-04-25T13:17:03.507510+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:17:03.507510+0000","last_undegraded":"2024-04-25T13:17:03.507510+0000","last_fullsized":"2024-04-25T13:17:03.507510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811882+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:17:02.811882+0000","last_peered":"2024-04-25T13:17:02.811882+0000","last_clean":"2024-04-25T13:17:02.811882+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:17:02.811882+0000","last_undegraded":"2024-04-25T13:17:02.811882+0000","last_fullsized":"2024-04-25T13:17:02.811882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.831521+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:17:10.831521+0000","last_peered":"2024-04-25T13:17:10.831521+0000","last_clean":"2024-04-25T13:17:10.831521+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:17:10.831521+0000","last_undegraded":"2024-04-25T13:17:10.831521+0000","last_fullsized":"2024-04-25T13:17:10.831521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:30.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814919+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:17:02.814919+0000","last_peered":"2024-04-25T13:17:02.814919+0000","last_clean":"2024-04-25T13:17:02.814919+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:17:02.814919+0000","last_undegraded":"2024-04-25T13:17:02.814919+0000","last_fullsized":"2024-04-25T13:17:02.814919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:14:01.832167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508089+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:17:03.508089+0000","last_peered":"2024-04-25T13:17:03.508089+0000","last_clean":"2024-04-25T13:17:03.508089+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:17:03.508089+0000","last_undegraded":"2024-04-25T13:17:03.508089+0000","last_fullsized":"2024-04-25T13:17:03.508089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811200+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:17:02.811200+0000","last_peered":"2024-04-25T13:17:02.811200+0000","last_clean":"2024-04-25T13:17:02.811200+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:17:02.811200+0000","last_undegraded":"2024-04-25T13:17:02.811200+0000","last_fullsized":"2024-04-25T13:17:02.811200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507642+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:17:03.507642+0000","last_peered":"2024-04-25T13:17:03.507642+0000","last_clean":"2024-04-25T13:17:03.507642+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:17:03.507642+0000","last_undegraded":"2024-04-25T13:17:03.507642+0000","last_fullsized":"2024-04-25T13:17:03.507642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815381+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:17:02.815381+0000","last_peered":"2024-04-25T13:17:02.815381+0000","last_clean":"2024-04-25T13:17:02.815381+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:17:02.815381+0000","last_undegraded":"2024-04-25T13:17:02.815381+0000","last_fullsized":"2024-04-25T13:17:02.815381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:53:02.784586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832870+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:17:10.832870+0000","last_peered":"2024-04-25T13:17:10.832870+0000","last_clean":"2024-04-25T13:17:10.832870+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:17:10.832870+0000","last_undegraded":"2024-04-25T13:17:10.832870+0000","last_fullsized":"2024-04-25T13:17:10.832870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507891+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:17:03.507891+0000","last_peered":"2024-04-25T13:17:03.507891+0000","last_clean":"2024-04-25T13:17:03.507891+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:17:03.507891+0000","last_undegraded":"2024-04-25T13:17:03.507891+0000","last_fullsized":"2024-04-25T13:17:03.507891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813293+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:17:02.813293+0000","last_peered":"2024-04-25T13:17:02.813293+0000","last_clean":"2024-04-25T13:17:02.813293+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:17:02.813293+0000","last_undegraded":"2024-04-25T13:17:02.813293+0000","last_fullsized":"2024-04-25T13:17:02.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814681+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:17:04.814681+0000","last_peered":"2024-04-25T13:17:04.814681+0000","last_clean":"2024-04-25T13:17:04.814681+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:17:04.814681+0000","last_undegraded":"2024-04-25T13:17:04.814681+0000","last_fullsized":"2024-04-25T13:17:04.814681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:21.075968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811569+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:17:02.811569+0000","last_peered":"2024-04-25T13:17:02.811569+0000","last_clean":"2024-04-25T13:17:02.811569+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:17:02.811569+0000","last_undegraded":"2024-04-25T13:17:02.811569+0000","last_fullsized":"2024-04-25T13:17:02.811569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814392+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:17:02.814392+0000","last_peered":"2024-04-25T13:17:02.814392+0000","last_clean":"2024-04-25T13:17:02.814392+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:17:02.814392+0000","last_undegraded":"2024-04-25T13:17:02.814392+0000","last_fullsized":"2024-04-25T13:17:02.814392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813543+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:17:04.813543+0000","last_peered":"2024-04-25T13:17:04.813543+0000","last_clean":"2024-04-25T13:17:04.813543+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:17:04.813543+0000","last_undegraded":"2024-04-25T13:17:04.813543+0000","last_fullsized":"2024-04-25T13:17:04.813543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819618+0000","last_change":"2024-04-25T13:17:02.819618+0000","last_active":"2024-04-25T13:17:02.819618+0000","last_peered":"2024-04-25T13:17:02.819618+0000","last_clean":"2024-04-25T13:17:02.819618+0000","last_became_active":"2024-04-25T13:17:02.819016+0000","last_became_peered":"2024-04-25T13:17:02.819016+0000","last_unstale":"2024-04-25T13:17:02.819618+0000","last_undegraded":"2024-04-25T13:17:02.819618+0000","last_fullsized":"2024-04-25T13:17:02.819618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:38.870384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814175+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:17:02.814175+0000","last_peered":"2024-04-25T13:17:02.814175+0000","last_clean":"2024-04-25T13:17:02.814175+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:17:02.814175+0000","last_undegraded":"2024-04-25T13:17:02.814175+0000","last_fullsized":"2024-04-25T13:17:02.814175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814551+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:17:02.814551+0000","last_peered":"2024-04-25T13:17:02.814551+0000","last_clean":"2024-04-25T13:17:02.814551+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:17:02.814551+0000","last_undegraded":"2024-04-25T13:17:02.814551+0000","last_fullsized":"2024-04-25T13:17:02.814551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:25.617949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813791+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:17:02.813791+0000","last_peered":"2024-04-25T13:17:02.813791+0000","last_clean":"2024-04-25T13:17:02.813791+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:17:02.813791+0000","last_undegraded":"2024-04-25T13:17:02.813791+0000","last_fullsized":"2024-04-25T13:17:02.813791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:25.195583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507846+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:17:03.507846+0000","last_peered":"2024-04-25T13:17:03.507846+0000","last_clean":"2024-04-25T13:17:03.507846+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:17:03.507846+0000","last_undegraded":"2024-04-25T13:17:03.507846+0000","last_fullsized":"2024-04-25T13:17:03.507846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836505+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:17:10.836505+0000","last_peered":"2024-04-25T13:17:10.836505+0000","last_clean":"2024-04-25T13:17:10.836505+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:17:10.836505+0000","last_undegraded":"2024-04-25T13:17:10.836505+0000","last_fullsized":"2024-04-25T13:17:10.836505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510055+0000","last_change":"2024-04-25T13:17:03.509676+0000","last_active":"2024-04-25T13:17:03.510055+0000","last_peered":"2024-04-25T13:17:03.510055+0000","last_clean":"2024-04-25T13:17:03.510055+0000","last_became_active":"2024-04-25T13:17:03.509216+0000","last_became_peered":"2024-04-25T13:17:03.509216+0000","last_unstale":"2024-04-25T13:17:03.510055+0000","last_undegraded":"2024-04-25T13:17:03.510055+0000","last_fullsized":"2024-04-25T13:17:03.510055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:03.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813502+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:17:02.813502+0000","last_peered":"2024-04-25T13:17:02.813502+0000","last_clean":"2024-04-25T13:17:02.813502+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:17:02.813502+0000","last_undegraded":"2024-04-25T13:17:02.813502+0000","last_fullsized":"2024-04-25T13:17:02.813502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832583+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:17:10.832583+0000","last_peered":"2024-04-25T13:17:10.832583+0000","last_clean":"2024-04-25T13:17:10.832583+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:17:10.832583+0000","last_undegraded":"2024-04-25T13:17:10.832583+0000","last_fullsized":"2024-04-25T13:17:10.832583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:49.765060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815038+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:17:02.815038+0000","last_peered":"2024-04-25T13:17:02.815038+0000","last_clean":"2024-04-25T13:17:02.815038+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:17:02.815038+0000","last_undegraded":"2024-04-25T13:17:02.815038+0000","last_fullsized":"2024-04-25T13:17:02.815038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:53.450399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815690+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:17:02.815690+0000","last_peered":"2024-04-25T13:17:02.815690+0000","last_clean":"2024-04-25T13:17:02.815690+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:17:02.815690+0000","last_undegraded":"2024-04-25T13:17:02.815690+0000","last_fullsized":"2024-04-25T13:17:02.815690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:40.864197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811263+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:17:02.811263+0000","last_peered":"2024-04-25T13:17:02.811263+0000","last_clean":"2024-04-25T13:17:02.811263+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:17:02.811263+0000","last_undegraded":"2024-04-25T13:17:02.811263+0000","last_fullsized":"2024-04-25T13:17:02.811263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815166+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:17:02.815166+0000","last_peered":"2024-04-25T13:17:02.815166+0000","last_clean":"2024-04-25T13:17:02.815166+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:17:02.815166+0000","last_undegraded":"2024-04-25T13:17:02.815166+0000","last_fullsized":"2024-04-25T13:17:02.815166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:11.644289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812304+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:17:02.812304+0000","last_peered":"2024-04-25T13:17:02.812304+0000","last_clean":"2024-04-25T13:17:02.812304+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:17:02.812304+0000","last_undegraded":"2024-04-25T13:17:02.812304+0000","last_fullsized":"2024-04-25T13:17:02.812304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813257+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:17:04.813257+0000","last_peered":"2024-04-25T13:17:04.813257+0000","last_clean":"2024-04-25T13:17:04.813257+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:17:04.813257+0000","last_undegraded":"2024-04-25T13:17:04.813257+0000","last_fullsized":"2024-04-25T13:17:04.813257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811317+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:17:02.811317+0000","last_peered":"2024-04-25T13:17:02.811317+0000","last_clean":"2024-04-25T13:17:02.811317+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:17:02.811317+0000","last_undegraded":"2024-04-25T13:17:02.811317+0000","last_fullsized":"2024-04-25T13:17:02.811317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508569+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:17:03.508569+0000","last_peered":"2024-04-25T13:17:03.508569+0000","last_clean":"2024-04-25T13:17:03.508569+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:17:03.508569+0000","last_undegraded":"2024-04-25T13:17:03.508569+0000","last_fullsized":"2024-04-25T13:17:03.508569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811924+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:17:02.811924+0000","last_peered":"2024-04-25T13:17:02.811924+0000","last_clean":"2024-04-25T13:17:02.811924+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:17:02.811924+0000","last_undegraded":"2024-04-25T13:17:02.811924+0000","last_fullsized":"2024-04-25T13:17:02.811924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.113778+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:17:19.113778+0000","last_peered":"2024-04-25T13:17:19.113778+0000","last_clean":"2024-04-25T13:17:19.113778+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:17:19.113778+0000","last_undegraded":"2024-04-25T13:17:19.113778+0000","last_fullsized":"2024-04-25T13:17:19.113778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:31.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507938+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:17:03.507938+0000","last_peered":"2024-04-25T13:17:03.507938+0000","last_clean":"2024-04-25T13:17:03.507938+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:17:03.507938+0000","last_undegraded":"2024-04-25T13:17:03.507938+0000","last_fullsized":"2024-04-25T13:17:03.507938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814058+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:17:02.814058+0000","last_peered":"2024-04-25T13:17:02.814058+0000","last_clean":"2024-04-25T13:17:02.814058+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:17:02.814058+0000","last_undegraded":"2024-04-25T13:17:02.814058+0000","last_fullsized":"2024-04-25T13:17:02.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.808777+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:17:04.808777+0000","last_peered":"2024-04-25T13:17:04.808777+0000","last_clean":"2024-04-25T13:17:04.808777+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:17:04.808777+0000","last_undegraded":"2024-04-25T13:17:04.808777+0000","last_fullsized":"2024-04-25T13:17:04.808777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:14.930726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816191+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:17:02.816191+0000","last_peered":"2024-04-25T13:17:02.816191+0000","last_clean":"2024-04-25T13:17:02.816191+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:17:02.816191+0000","last_undegraded":"2024-04-25T13:17:02.816191+0000","last_fullsized":"2024-04-25T13:17:02.816191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:53.310915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812288+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:17:02.812288+0000","last_peered":"2024-04-25T13:17:02.812288+0000","last_clean":"2024-04-25T13:17:02.812288+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:17:02.812288+0000","last_undegraded":"2024-04-25T13:17:02.812288+0000","last_fullsized":"2024-04-25T13:17:02.812288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835384+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:17:10.835384+0000","last_peered":"2024-04-25T13:17:10.835384+0000","last_clean":"2024-04-25T13:17:10.835384+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:17:10.835384+0000","last_undegraded":"2024-04-25T13:17:10.835384+0000","last_fullsized":"2024-04-25T13:17:10.835384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:03.820312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813046+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:17:02.813046+0000","last_peered":"2024-04-25T13:17:02.813046+0000","last_clean":"2024-04-25T13:17:02.813046+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:17:02.813046+0000","last_undegraded":"2024-04-25T13:17:02.813046+0000","last_fullsized":"2024-04-25T13:17:02.813046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811950+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:17:02.811950+0000","last_peered":"2024-04-25T13:17:02.811950+0000","last_clean":"2024-04-25T13:17:02.811950+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:17:02.811950+0000","last_undegraded":"2024-04-25T13:17:02.811950+0000","last_fullsized":"2024-04-25T13:17:02.811950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507795+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:17:03.507795+0000","last_peered":"2024-04-25T13:17:03.507795+0000","last_clean":"2024-04-25T13:17:03.507795+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:17:03.507795+0000","last_undegraded":"2024-04-25T13:17:03.507795+0000","last_fullsized":"2024-04-25T13:17:03.507795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507210+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:17:03.507210+0000","last_peered":"2024-04-25T13:17:03.507210+0000","last_clean":"2024-04-25T13:17:03.507210+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:17:03.507210+0000","last_undegraded":"2024-04-25T13:17:03.507210+0000","last_fullsized":"2024-04-25T13:17:03.507210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811434+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:17:02.811434+0000","last_peered":"2024-04-25T13:17:02.811434+0000","last_clean":"2024-04-25T13:17:02.811434+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:17:02.811434+0000","last_undegraded":"2024-04-25T13:17:02.811434+0000","last_fullsized":"2024-04-25T13:17:02.811434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.810341+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:17:04.810341+0000","last_peered":"2024-04-25T13:17:04.810341+0000","last_clean":"2024-04-25T13:17:04.810341+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:17:04.810341+0000","last_undegraded":"2024-04-25T13:17:04.810341+0000","last_fullsized":"2024-04-25T13:17:04.810341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:55:15.175278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814520+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:17:02.814520+0000","last_peered":"2024-04-25T13:17:02.814520+0000","last_clean":"2024-04-25T13:17:02.814520+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:17:02.814520+0000","last_undegraded":"2024-04-25T13:17:02.814520+0000","last_fullsized":"2024-04-25T13:17:02.814520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:38.025805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508154+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:17:03.508154+0000","last_peered":"2024-04-25T13:17:03.508154+0000","last_clean":"2024-04-25T13:17:03.508154+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:17:03.508154+0000","last_undegraded":"2024-04-25T13:17:03.508154+0000","last_fullsized":"2024-04-25T13:17:03.508154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.121264+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:17:19.121264+0000","last_peered":"2024-04-25T13:17:19.121264+0000","last_clean":"2024-04-25T13:17:19.121264+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:17:19.121264+0000","last_undegraded":"2024-04-25T13:17:19.121264+0000","last_fullsized":"2024-04-25T13:17:19.121264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812765+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:17:02.812765+0000","last_peered":"2024-04-25T13:17:02.812765+0000","last_clean":"2024-04-25T13:17:02.812765+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:17:02.812765+0000","last_undegraded":"2024-04-25T13:17:02.812765+0000","last_fullsized":"2024-04-25T13:17:02.812765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811663+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:17:02.811663+0000","last_peered":"2024-04-25T13:17:02.811663+0000","last_clean":"2024-04-25T13:17:02.811663+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:17:02.811663+0000","last_undegraded":"2024-04-25T13:17:02.811663+0000","last_fullsized":"2024-04-25T13:17:02.811663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813445+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:17:04.813445+0000","last_peered":"2024-04-25T13:17:04.813445+0000","last_clean":"2024-04-25T13:17:04.813445+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:17:04.813445+0000","last_undegraded":"2024-04-25T13:17:04.813445+0000","last_fullsized":"2024-04-25T13:17:04.813445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.818420+0000","last_change":"2024-04-25T13:17:02.818420+0000","last_active":"2024-04-25T13:17:02.818420+0000","last_peered":"2024-04-25T13:17:02.818420+0000","last_clean":"2024-04-25T13:17:02.818420+0000","last_became_active":"2024-04-25T13:17:02.817864+0000","last_became_peered":"2024-04-25T13:17:02.817864+0000","last_unstale":"2024-04-25T13:17:02.818420+0000","last_undegraded":"2024-04-25T13:17:02.818420+0000","last_fullsized":"2024-04-25T13:17:02.818420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:52.960881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815996+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:17:02.815996+0000","last_peered":"2024-04-25T13:17:02.815996+0000","last_clean":"2024-04-25T13:17:02.815996+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:17:02.815996+0000","last_undegraded":"2024-04-25T13:17:02.815996+0000","last_fullsized":"2024-04-25T13:17:02.815996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:45.389781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836070+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:17:10.836070+0000","last_peered":"2024-04-25T13:17:10.836070+0000","last_clean":"2024-04-25T13:17:10.836070+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:17:10.836070+0000","last_undegraded":"2024-04-25T13:17:10.836070+0000","last_fullsized":"2024-04-25T13:17:10.836070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:47.106528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813967+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:17:02.813967+0000","last_peered":"2024-04-25T13:17:02.813967+0000","last_clean":"2024-04-25T13:17:02.813967+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:17:02.813967+0000","last_undegraded":"2024-04-25T13:17:02.813967+0000","last_fullsized":"2024-04-25T13:17:02.813967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811857+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:17:02.811857+0000","last_peered":"2024-04-25T13:17:02.811857+0000","last_clean":"2024-04-25T13:17:02.811857+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:17:02.811857+0000","last_undegraded":"2024-04-25T13:17:02.811857+0000","last_fullsized":"2024-04-25T13:17:02.811857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.123871+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:17:19.123871+0000","last_peered":"2024-04-25T13:17:19.123871+0000","last_clean":"2024-04-25T13:17:19.123871+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:17:19.123871+0000","last_undegraded":"2024-04-25T13:17:19.123871+0000","last_fullsized":"2024-04-25T13:17:19.123871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813833+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:17:02.813833+0000","last_peered":"2024-04-25T13:17:02.813833+0000","last_clean":"2024-04-25T13:17:02.813833+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:17:02.813833+0000","last_undegraded":"2024-04-25T13:17:02.813833+0000","last_fullsized":"2024-04-25T13:17:02.813833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:56.704358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507633+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:17:03.507633+0000","last_peered":"2024-04-25T13:17:03.507633+0000","last_clean":"2024-04-25T13:17:03.507633+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:17:03.507633+0000","last_undegraded":"2024-04-25T13:17:03.507633+0000","last_fullsized":"2024-04-25T13:17:03.507633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815428+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:17:02.815428+0000","last_peered":"2024-04-25T13:17:02.815428+0000","last_clean":"2024-04-25T13:17:02.815428+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:17:02.815428+0000","last_undegraded":"2024-04-25T13:17:02.815428+0000","last_fullsized":"2024-04-25T13:17:02.815428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:16:27.914662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507401+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:17:03.507401+0000","last_peered":"2024-04-25T13:17:03.507401+0000","last_clean":"2024-04-25T13:17:03.507401+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:17:03.507401+0000","last_undegraded":"2024-04-25T13:17:03.507401+0000","last_fullsized":"2024-04-25T13:17:03.507401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814768+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:17:02.814768+0000","last_peered":"2024-04-25T13:17:02.814768+0000","last_clean":"2024-04-25T13:17:02.814768+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:17:02.814768+0000","last_undegraded":"2024-04-25T13:17:02.814768+0000","last_fullsized":"2024-04-25T13:17:02.814768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:51:57.601175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836480+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:17:10.836480+0000","last_peered":"2024-04-25T13:17:10.836480+0000","last_clean":"2024-04-25T13:17:10.836480+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:17:10.836480+0000","last_undegraded":"2024-04-25T13:17:10.836480+0000","last_fullsized":"2024-04-25T13:17:10.836480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811722+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:17:02.811722+0000","last_peered":"2024-04-25T13:17:02.811722+0000","last_clean":"2024-04-25T13:17:02.811722+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:17:02.811722+0000","last_undegraded":"2024-04-25T13:17:02.811722+0000","last_fullsized":"2024-04-25T13:17:02.811722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819428+0000","last_change":"2024-04-25T13:17:02.817603+0000","last_active":"2024-04-25T13:17:02.819428+0000","last_peered":"2024-04-25T13:17:02.819428+0000","last_clean":"2024-04-25T13:17:02.819428+0000","last_became_active":"2024-04-25T13:17:02.817270+0000","last_became_peered":"2024-04-25T13:17:02.817270+0000","last_unstale":"2024-04-25T13:17:02.819428+0000","last_undegraded":"2024-04-25T13:17:02.819428+0000","last_fullsized":"2024-04-25T13:17:02.819428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:29.177195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118727+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:17:19.118727+0000","last_peered":"2024-04-25T13:17:19.118727+0000","last_clean":"2024-04-25T13:17:19.118727+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:17:19.118727+0000","last_undegraded":"2024-04-25T13:17:19.118727+0000","last_fullsized":"2024-04-25T13:17:19.118727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811958+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:17:02.811958+0000","last_peered":"2024-04-25T13:17:02.811958+0000","last_clean":"2024-04-25T13:17:02.811958+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:17:02.811958+0000","last_undegraded":"2024-04-25T13:17:02.811958+0000","last_fullsized":"2024-04-25T13:17:02.811958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814326+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:17:02.814326+0000","last_peered":"2024-04-25T13:17:02.814326+0000","last_clean":"2024-04-25T13:17:02.814326+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:17:02.814326+0000","last_undegraded":"2024-04-25T13:17:02.814326+0000","last_fullsized":"2024-04-25T13:17:02.814326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:58.916894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813605+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:17:02.813605+0000","last_peered":"2024-04-25T13:17:02.813605+0000","last_clean":"2024-04-25T13:17:02.813605+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:17:02.813605+0000","last_undegraded":"2024-04-25T13:17:02.813605+0000","last_fullsized":"2024-04-25T13:17:02.813605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814202+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:17:04.814202+0000","last_peered":"2024-04-25T13:17:04.814202+0000","last_clean":"2024-04-25T13:17:04.814202+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:17:04.814202+0000","last_undegraded":"2024-04-25T13:17:04.814202+0000","last_fullsized":"2024-04-25T13:17:04.814202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508256+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:17:03.508256+0000","last_peered":"2024-04-25T13:17:03.508256+0000","last_clean":"2024-04-25T13:17:03.508256+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:17:03.508256+0000","last_undegraded":"2024-04-25T13:17:03.508256+0000","last_fullsized":"2024-04-25T13:17:03.508256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811828+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:17:02.811828+0000","last_peered":"2024-04-25T13:17:02.811828+0000","last_clean":"2024-04-25T13:17:02.811828+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:17:02.811828+0000","last_undegraded":"2024-04-25T13:17:02.811828+0000","last_fullsized":"2024-04-25T13:17:02.811828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814084+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:17:02.814084+0000","last_peered":"2024-04-25T13:17:02.814084+0000","last_clean":"2024-04-25T13:17:02.814084+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:17:02.814084+0000","last_undegraded":"2024-04-25T13:17:02.814084+0000","last_fullsized":"2024-04-25T13:17:02.814084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814176+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:17:04.814176+0000","last_peered":"2024-04-25T13:17:04.814176+0000","last_clean":"2024-04-25T13:17:04.814176+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:17:04.814176+0000","last_undegraded":"2024-04-25T13:17:04.814176+0000","last_fullsized":"2024-04-25T13:17:04.814176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816379+0000","last_change":"2024-04-25T13:16:21.676315+0000","last_active":"2024-04-25T13:17:02.816379+0000","last_peered":"2024-04-25T13:17:02.816379+0000","last_clean":"2024-04-25T13:17:02.816379+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:17:02.816379+0000","last_undegraded":"2024-04-25T13:17:02.816379+0000","last_fullsized":"2024-04-25T13:17:02.816379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:26.658206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815681+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:17:02.815681+0000","last_peered":"2024-04-25T13:17:02.815681+0000","last_clean":"2024-04-25T13:17:02.815681+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:17:02.815681+0000","last_undegraded":"2024-04-25T13:17:02.815681+0000","last_fullsized":"2024-04-25T13:17:02.815681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:10.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118875+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:17:19.118875+0000","last_peered":"2024-04-25T13:17:19.118875+0000","last_clean":"2024-04-25T13:17:19.118875+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:17:19.118875+0000","last_undegraded":"2024-04-25T13:17:19.118875+0000","last_fullsized":"2024-04-25T13:17:19.118875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507498+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:17:03.507498+0000","last_peered":"2024-04-25T13:17:03.507498+0000","last_clean":"2024-04-25T13:17:03.507498+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:17:03.507498+0000","last_undegraded":"2024-04-25T13:17:03.507498+0000","last_fullsized":"2024-04-25T13:17:03.507498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812540+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:17:02.812540+0000","last_peered":"2024-04-25T13:17:02.812540+0000","last_clean":"2024-04-25T13:17:02.812540+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:17:02.812540+0000","last_undegraded":"2024-04-25T13:17:02.812540+0000","last_fullsized":"2024-04-25T13:17:02.812540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508013+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:17:03.508013+0000","last_peered":"2024-04-25T13:17:03.508013+0000","last_clean":"2024-04-25T13:17:03.508013+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:17:03.508013+0000","last_undegraded":"2024-04-25T13:17:03.508013+0000","last_fullsized":"2024-04-25T13:17:03.508013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815859+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:17:02.815859+0000","last_peered":"2024-04-25T13:17:02.815859+0000","last_clean":"2024-04-25T13:17:02.815859+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:17:02.815859+0000","last_undegraded":"2024-04-25T13:17:02.815859+0000","last_fullsized":"2024-04-25T13:17:02.815859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:38.408945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813541+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:17:02.813541+0000","last_peered":"2024-04-25T13:17:02.813541+0000","last_clean":"2024-04-25T13:17:02.813541+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:17:02.813541+0000","last_undegraded":"2024-04-25T13:17:02.813541+0000","last_fullsized":"2024-04-25T13:17:02.813541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816291+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:17:02.816291+0000","last_peered":"2024-04-25T13:17:02.816291+0000","last_clean":"2024-04-25T13:17:02.816291+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:17:02.816291+0000","last_undegraded":"2024-04-25T13:17:02.816291+0000","last_fullsized":"2024-04-25T13:17:02.816291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:58.997591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812966+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:17:02.812966+0000","last_peered":"2024-04-25T13:17:02.812966+0000","last_clean":"2024-04-25T13:17:02.812966+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:17:02.812966+0000","last_undegraded":"2024-04-25T13:17:02.812966+0000","last_fullsized":"2024-04-25T13:17:02.812966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815198+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:17:02.815198+0000","last_peered":"2024-04-25T13:17:02.815198+0000","last_clean":"2024-04-25T13:17:02.815198+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:17:02.815198+0000","last_undegraded":"2024-04-25T13:17:02.815198+0000","last_fullsized":"2024-04-25T13:17:02.815198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508661+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:17:03.508661+0000","last_peered":"2024-04-25T13:17:03.508661+0000","last_clean":"2024-04-25T13:17:03.508661+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:17:03.508661+0000","last_undegraded":"2024-04-25T13:17:03.508661+0000","last_fullsized":"2024-04-25T13:17:03.508661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812859+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:17:02.812859+0000","last_peered":"2024-04-25T13:17:02.812859+0000","last_clean":"2024-04-25T13:17:02.812859+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:17:02.812859+0000","last_undegraded":"2024-04-25T13:17:02.812859+0000","last_fullsized":"2024-04-25T13:17:02.812859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813154+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:17:02.813154+0000","last_peered":"2024-04-25T13:17:02.813154+0000","last_clean":"2024-04-25T13:17:02.813154+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:17:02.813154+0000","last_undegraded":"2024-04-25T13:17:02.813154+0000","last_fullsized":"2024-04-25T13:17:02.813154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812212+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:17:02.812212+0000","last_peered":"2024-04-25T13:17:02.812212+0000","last_clean":"2024-04-25T13:17:02.812212+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:17:02.812212+0000","last_undegraded":"2024-04-25T13:17:02.812212+0000","last_fullsized":"2024-04-25T13:17:02.812212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813496+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:17:02.813496+0000","last_peered":"2024-04-25T13:17:02.813496+0000","last_clean":"2024-04-25T13:17:02.813496+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:17:02.813496+0000","last_undegraded":"2024-04-25T13:17:02.813496+0000","last_fullsized":"2024-04-25T13:17:02.813496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816090+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:17:02.816090+0000","last_peered":"2024-04-25T13:17:02.816090+0000","last_clean":"2024-04-25T13:17:02.816090+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:17:02.816090+0000","last_undegraded":"2024-04-25T13:17:02.816090+0000","last_fullsized":"2024-04-25T13:17:02.816090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:17.156145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508097+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:17:03.508097+0000","last_peered":"2024-04-25T13:17:03.508097+0000","last_clean":"2024-04-25T13:17:03.508097+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:17:03.508097+0000","last_undegraded":"2024-04-25T13:17:03.508097+0000","last_fullsized":"2024-04-25T13:17:03.508097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812095+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:17:02.812095+0000","last_peered":"2024-04-25T13:17:02.812095+0000","last_clean":"2024-04-25T13:17:02.812095+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:17:02.812095+0000","last_undegraded":"2024-04-25T13:17:02.812095+0000","last_fullsized":"2024-04-25T13:17:02.812095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816774+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:17:02.816774+0000","last_peered":"2024-04-25T13:17:02.816774+0000","last_clean":"2024-04-25T13:17:02.816774+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.816774+0000","last_undegraded":"2024-04-25T13:17:02.816774+0000","last_fullsized":"2024-04-25T13:17:02.816774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:09.316960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.819531+0000","last_change":"2024-04-25T13:17:02.818074+0000","last_active":"2024-04-25T13:17:02.819531+0000","last_peered":"2024-04-25T13:17:02.819531+0000","last_clean":"2024-04-25T13:17:02.819531+0000","last_became_active":"2024-04-25T13:17:02.817489+0000","last_became_peered":"2024-04-25T13:17:02.817489+0000","last_unstale":"2024-04-25T13:17:02.819531+0000","last_undegraded":"2024-04-25T13:17:02.819531+0000","last_fullsized":"2024-04-25T13:17:02.819531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:24.336162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813129+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:17:02.813129+0000","last_peered":"2024-04-25T13:17:02.813129+0000","last_clean":"2024-04-25T13:17:02.813129+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:17:02.813129+0000","last_undegraded":"2024-04-25T13:17:02.813129+0000","last_fullsized":"2024-04-25T13:17:02.813129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813390+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:17:02.813390+0000","last_peered":"2024-04-25T13:17:02.813390+0000","last_clean":"2024-04-25T13:17:02.813390+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:17:02.813390+0000","last_undegraded":"2024-04-25T13:17:02.813390+0000","last_fullsized":"2024-04-25T13:17:02.813390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815900+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:17:02.815900+0000","last_peered":"2024-04-25T13:17:02.815900+0000","last_clean":"2024-04-25T13:17:02.815900+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:17:02.815900+0000","last_undegraded":"2024-04-25T13:17:02.815900+0000","last_fullsized":"2024-04-25T13:17:02.815900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:35.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811962+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:17:02.811962+0000","last_peered":"2024-04-25T13:17:02.811962+0000","last_clean":"2024-04-25T13:17:02.811962+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.811962+0000","last_undegraded":"2024-04-25T13:17:02.811962+0000","last_fullsized":"2024-04-25T13:17:02.811962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507772+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:17:03.507772+0000","last_peered":"2024-04-25T13:17:03.507772+0000","last_clean":"2024-04-25T13:17:03.507772+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:17:03.507772+0000","last_undegraded":"2024-04-25T13:17:03.507772+0000","last_fullsized":"2024-04-25T13:17:03.507772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508579+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:17:03.508579+0000","last_peered":"2024-04-25T13:17:03.508579+0000","last_clean":"2024-04-25T13:17:03.508579+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:17:03.508579+0000","last_undegraded":"2024-04-25T13:17:03.508579+0000","last_fullsized":"2024-04-25T13:17:03.508579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508564+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:17:03.508564+0000","last_peered":"2024-04-25T13:17:03.508564+0000","last_clean":"2024-04-25T13:17:03.508564+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:17:03.508564+0000","last_undegraded":"2024-04-25T13:17:03.508564+0000","last_fullsized":"2024-04-25T13:17:03.508564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.823907+0000","last_change":"2024-04-25T13:17:02.819234+0000","last_active":"2024-04-25T13:17:02.823907+0000","last_peered":"2024-04-25T13:17:02.823907+0000","last_clean":"2024-04-25T13:17:02.823907+0000","last_became_active":"2024-04-25T13:17:02.818740+0000","last_became_peered":"2024-04-25T13:17:02.818740+0000","last_unstale":"2024-04-25T13:17:02.823907+0000","last_undegraded":"2024-04-25T13:17:02.823907+0000","last_fullsized":"2024-04-25T13:17:02.823907+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:30.255803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811710+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:17:02.811710+0000","last_peered":"2024-04-25T13:17:02.811710+0000","last_clean":"2024-04-25T13:17:02.811710+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:17:02.811710+0000","last_undegraded":"2024-04-25T13:17:02.811710+0000","last_fullsized":"2024-04-25T13:17:02.811710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811344+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:17:02.811344+0000","last_peered":"2024-04-25T13:17:02.811344+0000","last_clean":"2024-04-25T13:17:02.811344+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:17:02.811344+0000","last_undegraded":"2024-04-25T13:17:02.811344+0000","last_fullsized":"2024-04-25T13:17:02.811344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813459+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:17:02.813459+0000","last_peered":"2024-04-25T13:17:02.813459+0000","last_clean":"2024-04-25T13:17:02.813459+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:17:02.813459+0000","last_undegraded":"2024-04-25T13:17:02.813459+0000","last_fullsized":"2024-04-25T13:17:02.813459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811565+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:17:02.811565+0000","last_peered":"2024-04-25T13:17:02.811565+0000","last_clean":"2024-04-25T13:17:02.811565+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:17:02.811565+0000","last_undegraded":"2024-04-25T13:17:02.811565+0000","last_fullsized":"2024-04-25T13:17:02.811565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813964+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:17:02.813964+0000","last_peered":"2024-04-25T13:17:02.813964+0000","last_clean":"2024-04-25T13:17:02.813964+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:17:02.813964+0000","last_undegraded":"2024-04-25T13:17:02.813964+0000","last_fullsized":"2024-04-25T13:17:02.813964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814995+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:17:02.814995+0000","last_peered":"2024-04-25T13:17:02.814995+0000","last_clean":"2024-04-25T13:17:02.814995+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:17:02.814995+0000","last_undegraded":"2024-04-25T13:17:02.814995+0000","last_fullsized":"2024-04-25T13:17:02.814995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:20.534775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815920+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:17:02.815920+0000","last_peered":"2024-04-25T13:17:02.815920+0000","last_clean":"2024-04-25T13:17:02.815920+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:17:02.815920+0000","last_undegraded":"2024-04-25T13:17:02.815920+0000","last_fullsized":"2024-04-25T13:17:02.815920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:06.971761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812114+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:17:02.812114+0000","last_peered":"2024-04-25T13:17:02.812114+0000","last_clean":"2024-04-25T13:17:02.812114+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:17:02.812114+0000","last_undegraded":"2024-04-25T13:17:02.812114+0000","last_fullsized":"2024-04-25T13:17:02.812114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":123554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":120952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":124870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":121084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":710282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:30.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:31.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.038+0000 7f90008bb640 1 Processor -- start 2024-04-25T13:17:31.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.038+0000 7f90008bb640 1 -- start start 2024-04-25T13:17:31.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f90008bb640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ffc074d50 0x7f8ffc15b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:31.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f90008bb640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8ffc075130 0x7f8ffc075560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f90008bb640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc0cdcb0 con 0x7f8ffc15f190 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f90008bb640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc075aa0 con 0x7f8ffc074d50 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f90008bb640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0cdf70 con 0x7f8ffc075130 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f8ffa59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ffc074d50 0x7f8ffc15b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.039+0000 7f8ffa59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8ffc074d50 0x7f8ffc15b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58750/0 (socket says 172.21.15.155:58750) 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffa59c640 1 -- 172.21.15.155:0/1889027960 learned_addr learned my addr 172.21.15.155:0/1889027960 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:31.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffad9d640 1 --2- 172.21.15.155:0/1889027960 >> v2:172.21.15.191:3300/0 conn(0x7f8ffc075130 0x7f8ffc075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffa59c640 1 -- 172.21.15.155:0/1889027960 >> v2:172.21.15.191:3300/0 conn(0x7f8ffc075130 msgr2=0x7f8ffc075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffa59c640 1 --2- 172.21.15.155:0/1889027960 >> v2:172.21.15.191:3300/0 conn(0x7f8ffc075130 0x7f8ffc075560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffa59c640 1 -- 172.21.15.155:0/1889027960 >> v1:172.21.15.191:6789/0 conn(0x7f8ffc15f190 legacy=0x7f8ffc0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffa59c640 1 -- 172.21.15.155:0/1889027960 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0ce250 con 0x7f8ffc074d50 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.040+0000 7f8ffa59c640 1 --2- 172.21.15.155:0/1889027960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc074d50 0x7f8ffc15b9a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc06da70 tx=0x7f8fec02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17b9e3fcfb9e5de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f8ff959a640 1 -- 172.21.15.155:0/1889027960 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec036070 con 0x7f8ffc074d50 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f8ff959a640 1 -- 172.21.15.155:0/1889027960 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec031600 con 0x7f8ffc074d50 2024-04-25T13:17:31.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f8ff959a640 1 -- 172.21.15.155:0/1889027960 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0319d0 con 0x7f8ffc074d50 2024-04-25T13:17:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 -- 172.21.15.155:0/1889027960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc074d50 msgr2=0x7f8ffc15b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 --2- 172.21.15.155:0/1889027960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc074d50 0x7f8ffc15b9a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc06da70 tx=0x7f8fec02a780 comp rx=0 tx=0).stop 2024-04-25T13:17:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 -- 172.21.15.155:0/1889027960 shutdown_connections 2024-04-25T13:17:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 --2- 172.21.15.155:0/1889027960 >> v2:172.21.15.191:3300/0 conn(0x7f8ffc075130 0x7f8ffc075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 --2- 172.21.15.155:0/1889027960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc074d50 0x7f8ffc15b9a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 -- 172.21.15.155:0/1889027960 >> 172.21.15.155:0/1889027960 conn(0x7f8ffc06b920 msgr2=0x7f8ffc06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 -- 172.21.15.155:0/1889027960 shutdown_connections 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.041+0000 7f90008bb640 1 -- 172.21.15.155:0/1889027960 wait complete. 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 Processor -- start 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 -- start start 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ffc074d50 0x7f8ffc0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 0x7f8ffc15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ffc15f190 0x7f8ffc1f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:31.048 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc15ec70 con 0x7f8ffc075130 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc15e990 con 0x7f8ffc074d50 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f90008bb640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0cd4b0 con 0x7f8ffc15f190 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f8ff9d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 0x7f8ffc15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f8ff9d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 0x7f8ffc15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58760/0 (socket says 172.21.15.155:58760) 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.043+0000 7f8ff9d9b640 1 -- 172.21.15.155:0/2184305500 learned_addr learned my addr 172.21.15.155:0/2184305500 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ffa59c640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ffc074d50 0x7f8ffc0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ffad9d640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ffc15f190 0x7f8ffc1f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ff9d9b640 1 -- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ffc15f190 msgr2=0x7f8ffc1f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ff9d9b640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ffc15f190 0x7f8ffc1f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.049 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ff9d9b640 1 -- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ffc074d50 msgr2=0x7f8ffc0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ff9d9b640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ffc074d50 0x7f8ffc0ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ff9d9b640 1 -- 172.21.15.155:0/2184305500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0cd0e0 con 0x7f8ffc075130 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ffad9d640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ffc15f190 0x7f8ffc1f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8ff9d9b640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 0x7f8ffc15d5b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c430 tx=0x7f8ff000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0017070 con 0x7f8ffc075130 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff00035f0 con 0x7f8ffc075130 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc155990 con 0x7f8ffc075130 2024-04-25T13:17:31.050 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff00039e0 con 0x7f8ffc075130 2024-04-25T13:17:31.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.044+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc155f50 con 0x7f8ffc075130 2024-04-25T13:17:31.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.045+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc068e40 con 0x7f8ffc075130 2024-04-25T13:17:31.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.045+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ff001a070 con 0x7f8ffc075130 2024-04-25T13:17:31.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.046+0000 7f8feaffd640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fdc06c920 0x7f8fdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:31.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.046+0000 7f8ffa59c640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fdc06c920 0x7f8fdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:31.051 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.046+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8ff008b1c0 con 0x7f8ffc075130 2024-04-25T13:17:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.046+0000 7f8ffa59c640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fdc06c920 0x7f8fdc06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8fec033000 tx=0x7f8fec009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:31.052 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.050+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ff00010c0 con 0x7f8ffc075130 2024-04-25T13:17:31.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.226+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ffc0c8110 con 0x7f8ffc075130 2024-04-25T13:17:31.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.227+0000 7f8feaffd640 1 -- 172.21.15.155:0/2184305500 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7f8ff0058ba0 con 0x7f8ffc075130 2024-04-25T13:17:31.228 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:31.229 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fdc06c920 msgr2=0x7f8fdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fdc06c920 0x7f8fdc06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8fec033000 tx=0x7f8fec009000 comp rx=0 tx=0).stop 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 msgr2=0x7f8ffc15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 0x7f8ffc15d5b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ff000c430 tx=0x7f8ff000c8f0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 shutdown_connections 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fdc06c920 0x7f8fdc06ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8ffc15f190 0x7f8ffc1f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ffc075130 0x7f8ffc15d5b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 --2- 172.21.15.155:0/2184305500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8ffc074d50 0x7f8ffc0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:31.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 >> 172.21.15.155:0/2184305500 conn(0x7f8ffc06b920 msgr2=0x7f8ffc143460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:31.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 shutdown_connections 2024-04-25T13:17:31.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:31.229+0000 7f90008bb640 1 -- 172.21.15.155:0/2184305500 wait complete. 2024-04-25T13:17:32.242 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T13:17:32.243 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.355+0000 7f2374f20640 1 Processor -- start 2024-04-25T13:17:32.356 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.355+0000 7f2374f20640 1 -- start start 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f2374f20640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23701556d0 0x7f237015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f2374f20640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f23700cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f2374f20640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23700cbb60 con 0x7f23700cc600 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f2374f20640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f23700b35b0 con 0x7f23701556d0 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f2374f20640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f23700cdb20 con 0x7f23700cd170 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f236e59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23701556d0 0x7f237015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.358 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f236e59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f23701556d0 0x7f237015bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58776/0 (socket says 172.21.15.155:58776) 2024-04-25T13:17:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f236e59c640 1 -- 172.21.15.155:0/1912529839 learned_addr learned my addr 172.21.15.155:0/1912529839 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.356+0000 7f236ed9d640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f23700cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236e59c640 1 -- 172.21.15.155:0/1912529839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 msgr2=0x7f23700cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236e59c640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f23700cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236e59c640 1 -- 172.21.15.155:0/1912529839 >> v1:172.21.15.155:6789/0 conn(0x7f23700cc600 legacy=0x7f23700d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236e59c640 1 -- 172.21.15.155:0/1912529839 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23700b3990 con 0x7f23701556d0 2024-04-25T13:17:32.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236ed9d640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f23700cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:32.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236e59c640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f237015bbf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2360009870 tx=0x7f236002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962ff217f2c0a889 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236d59a640 1 -- 172.21.15.155:0/1912529839 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360037070 con 0x7f23701556d0 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236d59a640 1 -- 172.21.15.155:0/1912529839 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2360032440 con 0x7f23701556d0 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.357+0000 7f236d59a640 1 -- 172.21.15.155:0/1912529839 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360032810 con 0x7f23701556d0 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 -- 172.21.15.155:0/1912529839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 msgr2=0x7f237015bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f237015bbf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2360009870 tx=0x7f236002a250 comp rx=0 tx=0).stop 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 -- 172.21.15.155:0/1912529839 shutdown_connections 2024-04-25T13:17:32.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f23700cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 --2- 172.21.15.155:0/1912529839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f237015bbf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 -- 172.21.15.155:0/1912529839 >> 172.21.15.155:0/1912529839 conn(0x7f2370068360 msgr2=0x7f2370074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 -- 172.21.15.155:0/1912529839 shutdown_connections 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.358+0000 7f2374f20640 1 -- 172.21.15.155:0/1912529839 wait complete. 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.359+0000 7f2374f20640 1 Processor -- start 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.359+0000 7f2374f20640 1 -- start start 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f2374f20640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23700cc600 0x7f23701e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f2374f20640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f2370150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f2374f20640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f2370153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f2374f20640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23700b3c30 con 0x7f23701556d0 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f2374f20640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f23700cb880 con 0x7f23700cc600 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f2374f20640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f23700d0fa0 con 0x7f23700cd170 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f2370153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f2370153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58790/0 (socket says 172.21.15.155:58790) 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236ed9d640 1 -- 172.21.15.155:0/381875985 learned_addr learned my addr 172.21.15.155:0/381875985 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:32.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236e59c640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23700cc600 0x7f23701e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236dd9b640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f2370150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236ed9d640 1 -- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 msgr2=0x7f2370150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.360+0000 7f236ed9d640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f2370150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f236ed9d640 1 -- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23700cc600 msgr2=0x7f23701e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f236ed9d640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23700cc600 0x7f23701e4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f236ed9d640 1 -- 172.21.15.155:0/381875985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23700d0730 con 0x7f23701556d0 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f236dd9b640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f23700cd170 0x7f2370150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f236ed9d640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f2370153160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f236800cef0 tx=0x7f236800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236801a070 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f236800d860 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236800dc50 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23701e5170 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.361+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23700cf780 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.362+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2370068f50 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.362+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f236801d070 con 0x7f23701556d0 2024-04-25T13:17:32.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f235effd640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f235006c8f0 0x7f235006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f236808c770 con 0x7f23701556d0 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f236e59c640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f235006c8f0 0x7f235006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f235effd640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f2350076300 0x7f23500787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 --> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2350078e70 con 0x7f2350076300 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2368093050 con 0x7f23701556d0 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f236dd9b640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f2350076300 0x7f23500787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f236e59c640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f235006c8f0 0x7f235006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2360034000 tx=0x7f236002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.363+0000 7f236dd9b640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f2350076300 0x7f23500787a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.364+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== osd.0 v2:172.21.15.155:6800/2134228032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2350078e70 con 0x7f2350076300 2024-04-25T13:17:32.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.377+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 --> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23700cc130 con 0x7f2350076300 2024-04-25T13:17:32.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.377+0000 7f235effd640 1 -- 172.21.15.155:0/381875985 <== osd.0 v2:172.21.15.155:6800/2134228032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23700cc130 con 0x7f2350076300 2024-04-25T13:17:32.379 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:32.379 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:32.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f2350076300 msgr2=0x7f23500787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6800/2134228032,v1:172.21.15.155:6801/2134228032] conn(0x7f2350076300 0x7f23500787a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f235006c8f0 msgr2=0x7f235006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f235006c8f0 0x7f235006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2360034000 tx=0x7f236002e000 comp rx=0 tx=0).stop 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 msgr2=0x7f2370153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 --2- 172.21.15.155:0/381875985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23701556d0 0x7f2370153160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f236800cef0 tx=0x7f236800a710 comp rx=0 tx=0).stop 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f236ed9d640 1 -- 172.21.15.155:0/381875985 reap_dead start 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 shutdown_connections 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 >> 172.21.15.155:0/381875985 conn(0x7f2370068360 msgr2=0x7f2370154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 shutdown_connections 2024-04-25T13:17:32.381 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.378+0000 7f2374f20640 1 -- 172.21.15.155:0/381875985 wait complete. 2024-04-25T13:17:32.389 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T13:17:32.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.486+0000 7fef0ff5d640 1 Processor -- start 2024-04-25T13:17:32.487 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.486+0000 7fef0ff5d640 1 -- start start 2024-04-25T13:17:32.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0ff5d640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fef081553a0 0x7fef0815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0ff5d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef080c9440 0x7fef0806d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0ff5d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef080c8420 0x7fef080c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0ff5d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fef0815c0a0 con 0x7fef080c9440 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0ff5d640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fef0815efa0 con 0x7fef081553a0 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0ff5d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fef080c7970 con 0x7fef080c8420 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef080c9440 0x7fef0806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef080c9440 0x7fef0806d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58796/0 (socket says 172.21.15.155:58796) 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2293732839 learned_addr learned my addr 172.21.15.155:0/2293732839 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0dcf9640 1 --2- 172.21.15.155:0/2293732839 >> v2:172.21.15.191:3300/0 conn(0x7fef081553a0 0x7fef0815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0e4fa640 1 --2- 172.21.15.155:0/2293732839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef080c8420 0x7fef080c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2293732839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef080c8420 msgr2=0x7fef080c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 --2- 172.21.15.155:0/2293732839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef080c8420 0x7fef080c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2293732839 >> v2:172.21.15.191:3300/0 conn(0x7fef081553a0 msgr2=0x7fef0815bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 --2- 172.21.15.155:0/2293732839 >> v2:172.21.15.191:3300/0 conn(0x7fef081553a0 0x7fef0815bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.487+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2293732839 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef080c9190 con 0x7fef080c9440 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.488+0000 7fef0d4f8640 1 --2- 172.21.15.155:0/2293732839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef0806d020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fef08075b70 tx=0x7feef802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f86dc58dfd2c6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.488+0000 7fef0ccf7640 1 -- 172.21.15.155:0/2293732839 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8037070 con 0x7fef080c9440 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.488+0000 7fef0ccf7640 1 -- 172.21.15.155:0/2293732839 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef8032440 con 0x7fef080c9440 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.488+0000 7fef0ccf7640 1 -- 172.21.15.155:0/2293732839 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8032810 con 0x7fef080c9440 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.488+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2293732839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 msgr2=0x7fef0806d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.488+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2293732839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef0806d020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fef08075b70 tx=0x7feef802a270 comp rx=0 tx=0).stop 2024-04-25T13:17:32.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2293732839 shutdown_connections 2024-04-25T13:17:32.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2293732839 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef080c8420 0x7fef080c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2293732839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef0806d020 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2293732839 >> v2:172.21.15.191:3300/0 conn(0x7fef081553a0 0x7fef0815bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2293732839 >> 172.21.15.155:0/2293732839 conn(0x7fef080c9a70 msgr2=0x7fef080c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2293732839 shutdown_connections 2024-04-25T13:17:32.493 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.489+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2293732839 wait complete. 2024-04-25T13:17:32.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 Processor -- start 2024-04-25T13:17:32.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 -- start start 2024-04-25T13:17:32.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef080c8420 0x7fef081e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef081e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.496 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef081553a0 0x7fef0814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef0815e670 con 0x7fef080c9440 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fef080c7f20 con 0x7fef080c8420 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.490+0000 7fef0ff5d640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fef0815e950 con 0x7fef081553a0 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef081e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef081e43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58808/0 (socket says 172.21.15.155:58808) 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2809534275 learned_addr learned my addr 172.21.15.155:0/2809534275 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0dcf9640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef080c8420 0x7fef081e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.497 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef081553a0 msgr2=0x7fef0814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0e4fa640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef081553a0 0x7fef0814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef081553a0 0x7fef0814e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef080c8420 msgr2=0x7fef081e5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef080c8420 0x7fef081e5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 -- 172.21.15.155:0/2809534275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef08154b80 con 0x7fef080c9440 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0dcf9640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef080c8420 0x7fef081e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0d4f8640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef081e43b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feef8000c00 tx=0x7feef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8041020 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef80306c0 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef081f1990 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8037040 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.491+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef081e5630 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.492+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef08068e40 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.493+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feef8044020 con 0x7fef080c9440 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.493+0000 7feefe7fc640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feeec06c8f0 0x7feeec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.493+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7feef80ac710 con 0x7fef080c9440 2024-04-25T13:17:32.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.493+0000 7fef0dcf9640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feeec06c8f0 0x7feeec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.493+0000 7fef0dcf9640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feeec06c8f0 0x7feeec06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fef04006fd0 tx=0x7fef04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.497+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feef804b030 con 0x7fef080c9440 2024-04-25T13:17:32.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.675+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fef08154380 con 0x7feeec06c8f0 2024-04-25T13:17:32.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.675+0000 7feefe7fc640 1 -- 172.21.15.155:0/2809534275 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef08154380 con 0x7feeec06c8f0 2024-04-25T13:17:32.676 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T13:17:32.678 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feeec06c8f0 msgr2=0x7feeec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feeec06c8f0 0x7feeec06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fef04006fd0 tx=0x7fef04008040 comp rx=0 tx=0).stop 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 msgr2=0x7fef081e43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef081e43b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feef8000c00 tx=0x7feef80046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 shutdown_connections 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feeec06c8f0 0x7feeec06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fef081553a0 0x7fef0814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef080c9440 0x7fef081e43b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 --2- 172.21.15.155:0/2809534275 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fef080c8420 0x7fef081e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 >> 172.21.15.155:0/2809534275 conn(0x7fef080c9a70 msgr2=0x7fef0806d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 shutdown_connections 2024-04-25T13:17:32.680 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.677+0000 7fef0ff5d640 1 -- 172.21.15.155:0/2809534275 wait complete. 2024-04-25T13:17:32.689 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T13:17:32.689 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:32.790 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.789+0000 7fa1271cc640 1 Processor -- start 2024-04-25T13:17:32.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.789+0000 7fa1271cc640 1 -- start start 2024-04-25T13:17:32.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa1271cc640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa120073630 0x7fa1200c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.794 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa1271cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1200c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa1271cc640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1200c5f90 con 0x7fa1200c9d50 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa1271cc640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa1200c6af0 con 0x7fa120073630 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa1271cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa1200c6250 con 0x7fa120073a10 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa125769640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa1200c9d50 0x7fa120152c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36562/0 (socket says 172.21.15.155:36562) 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa125769640 1 -- 172.21.15.155:0/2532785859 learned_addr learned my addr 172.21.15.155:0/2532785859 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa11ffff640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1200c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa124f68640 1 --2- 172.21.15.155:0/2532785859 >> v2:172.21.15.191:3300/0 conn(0x7fa120073630 0x7fa1200c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.790+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697497788 0 0) 0x7fa1200c5f90 con 0x7fa1200c9d50 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa108003520 con 0x7fa1200c9d50 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1286804800 0 0) 0x7fa108003520 con 0x7fa1200c9d50 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 msgr2=0x7fa1200c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1200c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 >> v2:172.21.15.191:3300/0 conn(0x7fa120073630 msgr2=0x7fa1200c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 --2- 172.21.15.155:0/2532785859 >> v2:172.21.15.191:3300/0 conn(0x7fa120073630 0x7fa1200c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1200c6530 con 0x7fa1200c9d50 2024-04-25T13:17:32.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fa1180019f0 con 0x7fa1200c9d50 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 >> v1:172.21.15.155:6789/0 conn(0x7fa1200c9d50 legacy=0x7fa120152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa108003f30 0x7fa108004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108004d40 0x7fa1080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200c6af0 con 0x7fa108003f30 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200c6250 con 0x7fa108004d40 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa10800b9f0 con 0x7fa120073a10 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11ffff640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa108003f30 0x7fa108004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa125769640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108004d40 0x7fa1080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa124f68640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11ffff640 1 -- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 msgr2=0x7fa1080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11ffff640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11ffff640 1 -- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108004d40 msgr2=0x7fa1080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11ffff640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108004d40 0x7fa1080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa11ffff640 1 -- 172.21.15.155:0/2532785859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa108003520 con 0x7fa108003f30 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa125769640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108004d40 0x7fa1080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:32.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.791+0000 7fa124f68640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa120073a10 0x7fa1080039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.792+0000 7fa11ffff640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa108003f30 0x7fa108004800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa114009ac0 tx=0x7fa108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b7164a5557ffd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.792+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114036070 con 0x7fa108003f30 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.792+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114031400 con 0x7fa108003f30 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.792+0000 7fa11f7fe640 1 -- 172.21.15.155:0/2532785859 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114009690 con 0x7fa108003f30 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa1271cc640 1 -- 172.21.15.155:0/2532785859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa108003f30 msgr2=0x7fa108004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa1271cc640 1 --2- 172.21.15.155:0/2532785859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa108003f30 0x7fa108004800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa114009ac0 tx=0x7fa108005830 comp rx=0 tx=0).stop 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa125769640 1 -- 172.21.15.155:0/2532785859 reap_dead start 2024-04-25T13:17:32.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa1271cc640 1 -- 172.21.15.155:0/2532785859 shutdown_connections 2024-04-25T13:17:32.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa1271cc640 1 -- 172.21.15.155:0/2532785859 >> 172.21.15.155:0/2532785859 conn(0x7fa120068120 msgr2=0x7fa12006eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa1271cc640 1 -- 172.21.15.155:0/2532785859 shutdown_connections 2024-04-25T13:17:32.800 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.793+0000 7fa1271cc640 1 -- 172.21.15.155:0/2532785859 wait complete. 2024-04-25T13:17:32.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.794+0000 7fa1271cc640 1 Processor -- start 2024-04-25T13:17:32.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.794+0000 7fa1271cc640 1 -- start start 2024-04-25T13:17:32.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108003f30 0x7fa120154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa12014fa50 0x7fa120155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1201f1fa0 0x7fa1201f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1201533a0 con 0x7fa1201f1fa0 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa12015c4e0 con 0x7fa108003f30 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa120153520 con 0x7fa12014fa50 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1201f1fa0 0x7fa1201f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1201f1fa0 0x7fa1201f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48692/0 (socket says 172.21.15.155:48692) 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 -- 172.21.15.155:0/3713129060 learned_addr learned my addr 172.21.15.155:0/3713129060 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa124f68640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108003f30 0x7fa120154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa11ffff640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa12014fa50 0x7fa120155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 -- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa12014fa50 msgr2=0x7fa120155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa12014fa50 0x7fa120155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 -- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108003f30 msgr2=0x7fa120154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108003f30 0x7fa120154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 -- 172.21.15.155:0/3713129060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201537a0 con 0x7fa1201f1fa0 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa124f68640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa108003f30 0x7fa120154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa125769640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1201f1fa0 0x7fa1201f2420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa12006fb00 tx=0x7fa11800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11800ed40 con 0x7fa1201f1fa0 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa118014430 con 0x7fa1201f1fa0 2024-04-25T13:17:32.805 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1201546e0 con 0x7fa1201f1fa0 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa118014820 con 0x7fa1201f1fa0 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.795+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa120153a10 con 0x7fa1201f1fa0 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.796+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa120068f50 con 0x7fa1201f1fa0 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1180149c0 con 0x7fa1201f1fa0 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11d7fa640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa10c06c8f0 0x7fa10c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa124f68640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa10c06c8f0 0x7fa10c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.806 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa11808bd30 con 0x7fa1201f1fa0 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11d7fa640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7fa10c076300 0x7fa10c0787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 --> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa118014e50 con 0x7fa10c076300 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa11808e430 con 0x7fa1201f1fa0 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.797+0000 7fa11ffff640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7fa10c076300 0x7fa10c0787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.798+0000 7fa124f68640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa10c06c8f0 0x7fa10c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa110009bd0 tx=0x7fa110008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.798+0000 7fa11ffff640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7fa10c076300 0x7fa10c0787a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.807 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.798+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== osd.1 v2:172.21.15.155:6816/3446698651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa118014e50 con 0x7fa10c076300 2024-04-25T13:17:32.812 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.811+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 --> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa1201f2bb0 con 0x7fa10c076300 2024-04-25T13:17:32.813 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa11d7fa640 1 -- 172.21.15.155:0/3713129060 <== osd.1 v2:172.21.15.155:6816/3446698651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa1201f2bb0 con 0x7fa10c076300 2024-04-25T13:17:32.813 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:32.813 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:32.813 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:32.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7fa10c076300 msgr2=0x7fa10c0787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.814 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6816/3446698651,v1:172.21.15.155:6817/3446698651] conn(0x7fa10c076300 0x7fa10c0787a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa10c06c8f0 msgr2=0x7fa10c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa10c06c8f0 0x7fa10c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa110009bd0 tx=0x7fa110008040 comp rx=0 tx=0).stop 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1201f1fa0 msgr2=0x7fa1201f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 --2- 172.21.15.155:0/3713129060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1201f1fa0 0x7fa1201f2420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa12006fb00 tx=0x7fa11800e530 comp rx=0 tx=0).stop 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa125769640 1 -- 172.21.15.155:0/3713129060 reap_dead start 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 shutdown_connections 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 >> 172.21.15.155:0/3713129060 conn(0x7fa120068120 msgr2=0x7fa12014e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 shutdown_connections 2024-04-25T13:17:32.815 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.812+0000 7fa1271cc640 1 -- 172.21.15.155:0/3713129060 wait complete. 2024-04-25T13:17:32.824 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T13:17:32.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.921+0000 7fe125f07640 1 Processor -- start 2024-04-25T13:17:32.922 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.921+0000 7fe125f07640 1 -- start start 2024-04-25T13:17:32.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe125f07640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fe12006bf70 0x7fe12015af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe125f07640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 0x7fe1200c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe125f07640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe12015bef0 con 0x7fe12006bb90 2024-04-25T13:17:32.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe125f07640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fe12015f510 con 0x7fe12006bf70 2024-04-25T13:17:32.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe125f07640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe12015b650 con 0x7fe1200c99f0 2024-04-25T13:17:32.926 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11f7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe12006bb90 0x7fe12015ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36576/0 (socket says 172.21.15.155:36576) 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11f7fe640 1 -- 172.21.15.155:0/25616764 learned_addr learned my addr 172.21.15.155:0/25616764 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11ffff640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 0x7fe1200c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11effd640 1 --2- 172.21.15.155:0/25616764 >> v2:172.21.15.191:3300/0 conn(0x7fe12006bf70 0x7fe12015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270022328 0 0) 0x7fe12015bef0 con 0x7fe12006bb90 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe108003520 con 0x7fe12006bb90 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 189686136 0 0) 0x7fe108003520 con 0x7fe12006bb90 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 msgr2=0x7fe1200c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.927 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 0x7fe1200c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 >> v2:172.21.15.191:3300/0 conn(0x7fe12006bf70 msgr2=0x7fe12015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 --2- 172.21.15.155:0/25616764 >> v2:172.21.15.191:3300/0 conn(0x7fe12006bf70 0x7fe12015af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12015b930 con 0x7fe12006bb90 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.922+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7fe110001670 con 0x7fe12006bb90 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 >> v1:172.21.15.155:6789/0 conn(0x7fe12006bb90 legacy=0x7fe12015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1080039b0 0x7fe108003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe108004800 0x7fe108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 0x7fe1080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe12015f510 con 0x7fe108004800 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe12015b650 con 0x7fe1080039b0 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe10800b9c0 con 0x7fe1200c99f0 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11effd640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe108004800 0x7fe108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11f7fe640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1080039b0 0x7fe108003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11ffff640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 0x7fe1080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11effd640 1 -- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 msgr2=0x7fe1080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.929 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11effd640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe1200c99f0 0x7fe1080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11effd640 1 -- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1080039b0 msgr2=0x7fe108003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11effd640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1080039b0 0x7fe108003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.923+0000 7fe11effd640 1 -- 172.21.15.155:0/25616764 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108003520 con 0x7fe108004800 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe11effd640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe108004800 0x7fe108004c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe114009a90 tx=0x7fe108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1167cf4f274e4c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114036070 con 0x7fe108004800 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe114031400 con 0x7fe108004800 2024-04-25T13:17:32.930 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe11e7fc640 1 -- 172.21.15.155:0/25616764 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe114009690 con 0x7fe108004800 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe125f07640 1 -- 172.21.15.155:0/25616764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe108004800 msgr2=0x7fe108004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe125f07640 1 --2- 172.21.15.155:0/25616764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe108004800 0x7fe108004c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe114009a90 tx=0x7fe108005830 comp rx=0 tx=0).stop 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe11ffff640 1 -- 172.21.15.155:0/25616764 reap_dead start 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe125f07640 1 -- 172.21.15.155:0/25616764 shutdown_connections 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe125f07640 1 -- 172.21.15.155:0/25616764 >> 172.21.15.155:0/25616764 conn(0x7fe120074d50 msgr2=0x7fe120075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe125f07640 1 -- 172.21.15.155:0/25616764 shutdown_connections 2024-04-25T13:17:32.931 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.924+0000 7fe125f07640 1 -- 172.21.15.155:0/25616764 wait complete. 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.925+0000 7fe125f07640 1 Processor -- start 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 -- start start 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe108004800 0x7fe12014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe120155e10 0x7fe1201f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 0x7fe12014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe12015e8e0 con 0x7fe120150ab0 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fe12015e600 con 0x7fe108004800 2024-04-25T13:17:32.934 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe125f07640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fe120074560 con 0x7fe120155e10 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe11ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 0x7fe12014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe11ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 0x7fe12014ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48714/0 (socket says 172.21.15.155:48714) 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.926+0000 7fe11ffff640 1 -- 172.21.15.155:0/1421087481 learned_addr learned my addr 172.21.15.155:0/1421087481 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11f7fe640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe108004800 0x7fe12014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11effd640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe120155e10 0x7fe1201f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11ffff640 1 -- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe120155e10 msgr2=0x7fe1201f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11ffff640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe120155e10 0x7fe1201f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.935 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11ffff640 1 -- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe108004800 msgr2=0x7fe12014fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11ffff640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe108004800 0x7fe12014fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11ffff640 1 -- 172.21.15.155:0/1421087481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe12015ad60 con 0x7fe120150ab0 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11f7fe640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe108004800 0x7fe12014fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe11ffff640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 0x7fe12014ae50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1200732e0 tx=0x7fe11800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118015430 con 0x7fe120150ab0 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe11801d070 con 0x7fe120150ab0 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe118015830 con 0x7fe120150ab0 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12015a7a0 con 0x7fe120150ab0 2024-04-25T13:17:32.936 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.927+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe12014f260 con 0x7fe120150ab0 2024-04-25T13:17:32.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.928+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe120068e40 con 0x7fe120150ab0 2024-04-25T13:17:32.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.928+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1180159d0 con 0x7fe120150ab0 2024-04-25T13:17:32.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.929+0000 7fe107fff640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe10c06c8f0 0x7fe10c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:32.937 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.929+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe11808c7d0 con 0x7fe120150ab0 2024-04-25T13:17:32.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.929+0000 7fe11f7fe640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe10c06c8f0 0x7fe10c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:32.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.929+0000 7fe11f7fe640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe10c06c8f0 0x7fe10c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe110001050 tx=0x7fe110009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:32.939 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:32.933+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe118010040 con 0x7fe120150ab0 2024-04-25T13:17:33.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.110+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe1201561f0 con 0x7fe10c06c8f0 2024-04-25T13:17:33.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.110+0000 7fe107fff640 1 -- 172.21.15.155:0/1421087481 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe1201561f0 con 0x7fe10c06c8f0 2024-04-25T13:17:33.112 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T13:17:33.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe10c06c8f0 msgr2=0x7fe10c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe10c06c8f0 0x7fe10c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe110001050 tx=0x7fe110009040 comp rx=0 tx=0).stop 2024-04-25T13:17:33.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 msgr2=0x7fe12014ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 0x7fe12014ae50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1200732e0 tx=0x7fe11800f580 comp rx=0 tx=0).stop 2024-04-25T13:17:33.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 shutdown_connections 2024-04-25T13:17:33.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe120150ab0 0x7fe12014ae50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fe10c06c8f0 0x7fe10c06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fe120155e10 0x7fe1201f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 --2- 172.21.15.155:0/1421087481 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe108004800 0x7fe12014fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 >> 172.21.15.155:0/1421087481 conn(0x7fe120074d50 msgr2=0x7fe1200cac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 shutdown_connections 2024-04-25T13:17:33.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.113+0000 7fe125f07640 1 -- 172.21.15.155:0/1421087481 wait complete. 2024-04-25T13:17:33.125 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T13:17:33.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:33.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.225+0000 7f59f9730640 1 Processor -- start 2024-04-25T13:17:33.226 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.225+0000 7f59f9730640 1 -- start start 2024-04-25T13:17:33.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f9730640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f9730640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f59f415b8e0 0x7f59f415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f9730640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59f4070080 con 0x7f59f40734f0 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f9730640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f59f415c240 con 0x7f59f415b8e0 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f9730640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f59f4073060 con 0x7f59f415b500 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f37fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f59f40734f0 0x7f59f4073980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36580/0 (socket says 172.21.15.155:36580) 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f37fe640 1 -- 172.21.15.155:0/2771142407 learned_addr learned my addr 172.21.15.155:0/2771142407 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f27fc640 1 --2- 172.21.15.155:0/2771142407 >> v2:172.21.15.191:3300/0 conn(0x7f59f415b8e0 0x7f59f415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.226+0000 7f59f2ffd640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f1ffb640 1 -- 172.21.15.155:0/2771142407 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278865192 0 0) 0x7f59f4070080 con 0x7f59f40734f0 2024-04-25T13:17:33.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f1ffb640 1 -- 172.21.15.155:0/2771142407 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59dc003520 con 0x7f59f40734f0 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f27fc640 1 -- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 msgr2=0x7f59f40c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f27fc640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f27fc640 1 -- 172.21.15.155:0/2771142407 >> v1:172.21.15.155:6789/0 conn(0x7f59f40734f0 legacy=0x7f59f4073980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f27fc640 1 -- 172.21.15.155:0/2771142407 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f4070320 con 0x7f59f415b8e0 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f2ffd640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.227+0000 7f59f27fc640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f415b8e0 0x7f59f415bd00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59e80097a0 tx=0x7f59e802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2913df070e9281 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f1ffb640 1 -- 172.21.15.155:0/2771142407 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8037070 con 0x7f59f415b8e0 2024-04-25T13:17:33.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f1ffb640 1 -- 172.21.15.155:0/2771142407 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e8032440 con 0x7f59f415b8e0 2024-04-25T13:17:33.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f1ffb640 1 -- 172.21.15.155:0/2771142407 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e80327f0 con 0x7f59f415b8e0 2024-04-25T13:17:33.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 -- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f415b8e0 msgr2=0x7f59f415bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f415b8e0 0x7f59f415bd00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59e80097a0 tx=0x7f59e802a210 comp rx=0 tx=0).stop 2024-04-25T13:17:33.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 -- 172.21.15.155:0/2771142407 shutdown_connections 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f415b8e0 0x7f59f415bd00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 --2- 172.21.15.155:0/2771142407 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 -- 172.21.15.155:0/2771142407 >> 172.21.15.155:0/2771142407 conn(0x7f59f40cd840 msgr2=0x7f59f40cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 -- 172.21.15.155:0/2771142407 shutdown_connections 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.228+0000 7f59f9730640 1 -- 172.21.15.155:0/2771142407 wait complete. 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.229+0000 7f59f9730640 1 Processor -- start 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.229+0000 7f59f9730640 1 -- start start 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f9730640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f40734f0 0x7f59f41ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f9730640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f9730640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59f415b8e0 0x7f59f415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f9730640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4070ba0 con 0x7f59f415b8e0 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f9730640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f59f40708c0 con 0x7f59f40734f0 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f9730640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f59f406fc20 con 0x7f59f415b500 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59f415b8e0 0x7f59f415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59f415b8e0 0x7f59f415a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48728/0 (socket says 172.21.15.155:48728) 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f37fe640 1 -- 172.21.15.155:0/2576700663 learned_addr learned my addr 172.21.15.155:0/2576700663 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f2ffd640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f40734f0 0x7f59f41ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.230+0000 7f59f27fc640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f37fe640 1 -- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 msgr2=0x7f59f40c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f37fe640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f59f415b500 0x7f59f40c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f37fe640 1 -- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f40734f0 msgr2=0x7f59f41ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f37fe640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f40734f0 0x7f59f41ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f37fe640 1 -- 172.21.15.155:0/2576700663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f40c7e00 con 0x7f59f415b8e0 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f2ffd640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59f40734f0 0x7f59f41ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f37fe640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59f415b8e0 0x7f59f415a330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00e6e0 tx=0x7f59ec00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec015070 con 0x7f59f415b8e0 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec005ab0 con 0x7f59f415b8e0 2024-04-25T13:17:33.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f40c80e0 con 0x7f59f415b8e0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec00c850 con 0x7f59f415b8e0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.231+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f40c61e0 con 0x7f59f415b8e0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.232+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59f415acd0 con 0x7f59f415b8e0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.232+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59ec018070 con 0x7f59f415b8e0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59db7fe640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f59e006c920 0x7f59e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f59ec08e0e0 con 0x7f59f415b8e0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59f2ffd640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f59e006c920 0x7f59e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59db7fe640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f59e0076330 0x7f59e00787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.238 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 --> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59e0078ea0 con 0x7f59e0076330 2024-04-25T13:17:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f59ec095050 con 0x7f59f415b8e0 2024-04-25T13:17:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59f27fc640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f59e0076330 0x7f59e00787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.233+0000 7f59f2ffd640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f59e006c920 0x7f59e006ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59e40074d0 tx=0x7f59e400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.234+0000 7f59f27fc640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f59e0076330 0x7f59e00787d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.234+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== osd.2 v2:172.21.15.155:6824/3777344599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59e0078ea0 con 0x7f59e0076330 2024-04-25T13:17:33.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.247+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 --> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59f4068f50 con 0x7f59e0076330 2024-04-25T13:17:33.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.247+0000 7f59db7fe640 1 -- 172.21.15.155:0/2576700663 <== osd.2 v2:172.21.15.155:6824/3777344599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f59f4068f50 con 0x7f59e0076330 2024-04-25T13:17:33.249 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:33.249 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:33.249 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:33.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f59e0076330 msgr2=0x7f59e00787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6824/3777344599,v1:172.21.15.155:6825/3777344599] conn(0x7f59e0076330 0x7f59e00787d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f59e006c920 msgr2=0x7f59e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f59e006c920 0x7f59e006ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59e40074d0 tx=0x7f59e400b040 comp rx=0 tx=0).stop 2024-04-25T13:17:33.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59f415b8e0 msgr2=0x7f59f415a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 --2- 172.21.15.155:0/2576700663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59f415b8e0 0x7f59f415a330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59ec00e6e0 tx=0x7f59ec00eba0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f37fe640 1 -- 172.21.15.155:0/2576700663 reap_dead start 2024-04-25T13:17:33.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 shutdown_connections 2024-04-25T13:17:33.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 >> 172.21.15.155:0/2576700663 conn(0x7f59f40cd840 msgr2=0x7f59f414f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 shutdown_connections 2024-04-25T13:17:33.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.248+0000 7f59f9730640 1 -- 172.21.15.155:0/2576700663 wait complete. 2024-04-25T13:17:33.259 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T13:17:33.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.356+0000 7ff7bc86b640 1 Processor -- start 2024-04-25T13:17:33.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.356+0000 7ff7bc86b640 1 -- start start 2024-04-25T13:17:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7bc86b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b815efa0 0x7ff7b8074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7bc86b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b8144650 con 0x7ff7b8075290 2024-04-25T13:17:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7bc86b640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b815b0b0 con 0x7ff7b8144270 2024-04-25T13:17:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7bc86b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b80c9580 con 0x7ff7b815efa0 2024-04-25T13:17:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7affff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b815efa0 0x7ff7b8074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7affff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff7b815efa0 0x7ff7b8074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48736/0 (socket says 172.21.15.155:48736) 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7affff640 1 -- 172.21.15.155:0/3587237363 learned_addr learned my addr 172.21.15.155:0/3587237363 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7affff640 1 -- 172.21.15.155:0/3587237363 >> v1:172.21.15.191:6789/0 conn(0x7ff7b8144270 legacy=0x7ff7b80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7affff640 1 -- 172.21.15.155:0/3587237363 >> v1:172.21.15.155:6789/0 conn(0x7ff7b8075290 legacy=0x7ff7b8165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.357+0000 7ff7affff640 1 -- 172.21.15.155:0/3587237363 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80ce080 con 0x7ff7b815efa0 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7affff640 1 --2- 172.21.15.155:0/3587237363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b8074d50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009870 tx=0x7ff7a002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06fc15b30423779 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7b5d9b640 1 -- 172.21.15.155:0/3587237363 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0037070 con 0x7ff7b815efa0 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7b5d9b640 1 -- 172.21.15.155:0/3587237363 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a0032640 con 0x7ff7b815efa0 2024-04-25T13:17:33.360 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7b5d9b640 1 -- 172.21.15.155:0/3587237363 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0032a10 con 0x7ff7b815efa0 2024-04-25T13:17:33.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7bc86b640 1 -- 172.21.15.155:0/3587237363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 msgr2=0x7ff7b8074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/3587237363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b8074d50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009870 tx=0x7ff7a002a330 comp rx=0 tx=0).stop 2024-04-25T13:17:33.363 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7bc86b640 1 -- 172.21.15.155:0/3587237363 shutdown_connections 2024-04-25T13:17:33.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/3587237363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b8074d50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.358+0000 7ff7bc86b640 1 -- 172.21.15.155:0/3587237363 >> 172.21.15.155:0/3587237363 conn(0x7ff7b806b920 msgr2=0x7ff7b806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.359+0000 7ff7bc86b640 1 -- 172.21.15.155:0/3587237363 shutdown_connections 2024-04-25T13:17:33.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.359+0000 7ff7bc86b640 1 -- 172.21.15.155:0/3587237363 wait complete. 2024-04-25T13:17:33.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 Processor -- start 2024-04-25T13:17:33.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 -- start start 2024-04-25T13:17:33.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7b8075290 0x7ff7b80cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7b8144270 0x7ff7b80ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b815b8e0 con 0x7ff7b815efa0 2024-04-25T13:17:33.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b815b600 con 0x7ff7b8075290 2024-04-25T13:17:33.366 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.360+0000 7ff7bc86b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b80ce360 con 0x7ff7b8144270 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b813ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48742/0 (socket says 172.21.15.155:48742) 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 -- 172.21.15.155:0/317865853 learned_addr learned my addr 172.21.15.155:0/317865853 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b659c640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7b8075290 0x7ff7b80cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7affff640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7b8144270 0x7ff7b80ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 -- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7b8144270 msgr2=0x7ff7b80ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.367 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7b8144270 0x7ff7b80ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 -- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7b8075290 msgr2=0x7ff7b80cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7b8075290 0x7ff7b80cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 -- 172.21.15.155:0/317865853 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b815e0f0 con 0x7ff7b815efa0 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7b6d9d640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b813ee10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c7d0 tx=0x7ff7b000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003b70 con 0x7ff7b815efa0 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b0003d30 con 0x7ff7b815efa0 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b80c4bb0 con 0x7ff7b815efa0 2024-04-25T13:17:33.368 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000aa90 con 0x7ff7b815efa0 2024-04-25T13:17:33.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.361+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b80cb360 con 0x7ff7b815efa0 2024-04-25T13:17:33.369 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.362+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b8073380 con 0x7ff7b815efa0 2024-04-25T13:17:33.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.363+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7b000ac30 con 0x7ff7b815efa0 2024-04-25T13:17:33.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.363+0000 7ff7aeffd640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff79806c8f0 0x7ff79806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.363+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff7b008bdc0 con 0x7ff7b815efa0 2024-04-25T13:17:33.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.363+0000 7ff7b659c640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff79806c8f0 0x7ff79806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.364+0000 7ff7b659c640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff79806c8f0 0x7ff79806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8004f60 tx=0x7ff7a8007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.370 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.367+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7b8073380 con 0x7ff7b815efa0 2024-04-25T13:17:33.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.542+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff7b80cbb40 con 0x7ff79806c8f0 2024-04-25T13:17:33.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.542+0000 7ff7aeffd640 1 -- 172.21.15.155:0/317865853 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7b80cbb40 con 0x7ff79806c8f0 2024-04-25T13:17:33.543 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T13:17:33.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff79806c8f0 msgr2=0x7ff79806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff79806c8f0 0x7ff79806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8004f60 tx=0x7ff7a8007e30 comp rx=0 tx=0).stop 2024-04-25T13:17:33.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 msgr2=0x7ff7b813ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b813ee10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c7d0 tx=0x7ff7b000cc90 comp rx=0 tx=0).stop 2024-04-25T13:17:33.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 shutdown_connections 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7b815efa0 0x7ff7b813ee10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff79806c8f0 0x7ff79806edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff7b8144270 0x7ff7b80ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 --2- 172.21.15.155:0/317865853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7b8075290 0x7ff7b80cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 >> 172.21.15.155:0/317865853 conn(0x7ff7b806b920 msgr2=0x7ff7b80c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 shutdown_connections 2024-04-25T13:17:33.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.544+0000 7ff7bc86b640 1 -- 172.21.15.155:0/317865853 wait complete. 2024-04-25T13:17:33.556 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T13:17:33.557 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:33.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 Processor -- start 2024-04-25T13:17:33.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 -- start start 2024-04-25T13:17:33.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f466c0ca650 0x7f466c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073a00 0x7f466c1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466c0c6390 con 0x7f466c073620 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f466c0cbf20 con 0x7f466c0ca650 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.658+0000 7f4671c05640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0cb5f0 con 0x7f466c073a00 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466bfff640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073a00 0x7f466c1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466affd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f466c0ca650 0x7f466c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466b7fe640 1 --1- >> v1:172.21.15.191:6789/0 conn(0x7f466c073620 0x7f466c0c5bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.191:6789/0 says I am v1:172.21.15.155:50494/0 (socket says 172.21.15.155:50494) 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466b7fe640 1 -- 172.21.15.155:0/1542914048 learned_addr learned my addr 172.21.15.155:0/1542914048 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466bfff640 1 -- 172.21.15.155:0/1542914048 >> v2:172.21.15.191:3300/0 conn(0x7f466c0ca650 msgr2=0x7f466c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:33.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466bfff640 1 --2- 172.21.15.155:0/1542914048 >> v2:172.21.15.191:3300/0 conn(0x7f466c0ca650 0x7f466c152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466bfff640 1 -- 172.21.15.155:0/1542914048 >> v1:172.21.15.191:6789/0 conn(0x7f466c073620 legacy=0x7f466c0c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.659+0000 7f466bfff640 1 -- 172.21.15.155:0/1542914048 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c0cb8d0 con 0x7f466c073a00 2024-04-25T13:17:33.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.660+0000 7f466bfff640 1 --2- 172.21.15.155:0/1542914048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073a00 0x7f466c1530b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4664009dc0 tx=0x7f466402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1689c39302e71a43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.660+0000 7f466a7fc640 1 -- 172.21.15.155:0/1542914048 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466402ae60 con 0x7f466c073a00 2024-04-25T13:17:33.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.660+0000 7f466a7fc640 1 -- 172.21.15.155:0/1542914048 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4664007740 con 0x7f466c073a00 2024-04-25T13:17:33.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.660+0000 7f466a7fc640 1 -- 172.21.15.155:0/1542914048 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664007b10 con 0x7f466c073a00 2024-04-25T13:17:33.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 -- 172.21.15.155:0/1542914048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073a00 msgr2=0x7f466c1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 --2- 172.21.15.155:0/1542914048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073a00 0x7f466c1530b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4664009dc0 tx=0x7f466402a680 comp rx=0 tx=0).stop 2024-04-25T13:17:33.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 -- 172.21.15.155:0/1542914048 shutdown_connections 2024-04-25T13:17:33.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 --2- 172.21.15.155:0/1542914048 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073a00 0x7f466c1530b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 --2- 172.21.15.155:0/1542914048 >> v2:172.21.15.191:3300/0 conn(0x7f466c0ca650 0x7f466c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 -- 172.21.15.155:0/1542914048 >> 172.21.15.155:0/1542914048 conn(0x7f466c068120 msgr2=0x7f466c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 -- 172.21.15.155:0/1542914048 shutdown_connections 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.661+0000 7f4671c05640 1 -- 172.21.15.155:0/1542914048 wait complete. 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.662+0000 7f4671c05640 1 Processor -- start 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.662+0000 7f4671c05640 1 -- start start 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073620 0x7f466c14d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c073a00 0x7f466c158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.668 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466c0ca650 0x7f466c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0cab20 con 0x7f466c0ca650 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f466c0c6670 con 0x7f466c073a00 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f466c0caca0 con 0x7f466c073620 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466c0ca650 0x7f466c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466c0ca650 0x7f466c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48750/0 (socket says 172.21.15.155:48750) 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 -- 172.21.15.155:0/1674625900 learned_addr learned my addr 172.21.15.155:0/1674625900 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466b7fe640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073620 0x7f466c14d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466affd640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c073a00 0x7f466c158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 -- 172.21.15.155:0/1674625900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073620 msgr2=0x7f466c14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f466c073620 0x7f466c14d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 -- 172.21.15.155:0/1674625900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c073a00 msgr2=0x7f466c158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f466c073a00 0x7f466c158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 -- 172.21.15.155:0/1674625900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c06d1e0 con 0x7f466c0ca650 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f466bfff640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466c0ca650 0x7f466c0cdb30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ee0 tx=0x7f4664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466403f070 con 0x7f466c0ca650 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466402ae60 con 0x7f466c0ca650 2024-04-25T13:17:33.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c14d590 con 0x7f466c0ca650 2024-04-25T13:17:33.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.663+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664031be0 con 0x7f466c0ca650 2024-04-25T13:17:33.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.664+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c1f4ee0 con 0x7f466c0ca650 2024-04-25T13:17:33.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.664+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f466c070900 con 0x7f466c0ca650 2024-04-25T13:17:33.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.665+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f466403b410 con 0x7f466c0ca650 2024-04-25T13:17:33.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.665+0000 7f4653fff640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f465806c8f0 0x7f465806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.665+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f46640ad2d0 con 0x7f466c0ca650 2024-04-25T13:17:33.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.665+0000 7f466b7fe640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f465806c8f0 0x7f465806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.665+0000 7f4653fff640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f4658076300 0x7f46580787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.666+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 --> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46640020b0 con 0x7f4658076300 2024-04-25T13:17:33.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.666+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46640b4050 con 0x7f466c0ca650 2024-04-25T13:17:33.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.666+0000 7f466affd640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f4658076300 0x7f46580787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.666+0000 7f466b7fe640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f465806c8f0 0x7f465806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f465c007fd0 tx=0x7f465c007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.666+0000 7f466affd640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f4658076300 0x7f46580787a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.667+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== osd.3 v2:172.21.15.155:6802/1299092023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46640020b0 con 0x7f4658076300 2024-04-25T13:17:33.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.681+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 --> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f466c068f50 con 0x7f4658076300 2024-04-25T13:17:33.682 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.681+0000 7f4653fff640 1 -- 172.21.15.155:0/1674625900 <== osd.3 v2:172.21.15.155:6802/1299092023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f466c068f50 con 0x7f4658076300 2024-04-25T13:17:33.682 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:33.683 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:33.683 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f4658076300 msgr2=0x7f46580787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6802/1299092023,v1:172.21.15.155:6805/1299092023] conn(0x7f4658076300 0x7f46580787a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f465806c8f0 msgr2=0x7f465806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f465806c8f0 0x7f465806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f465c007fd0 tx=0x7f465c007e80 comp rx=0 tx=0).stop 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466c0ca650 msgr2=0x7f466c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 --2- 172.21.15.155:0/1674625900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466c0ca650 0x7f466c0cdb30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ee0 tx=0x7f4664004a40 comp rx=0 tx=0).stop 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f466bfff640 1 -- 172.21.15.155:0/1674625900 reap_dead start 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 shutdown_connections 2024-04-25T13:17:33.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 >> 172.21.15.155:0/1674625900 conn(0x7f466c068120 msgr2=0x7f466c144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 shutdown_connections 2024-04-25T13:17:33.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.682+0000 7f4671c05640 1 -- 172.21.15.155:0/1674625900 wait complete. 2024-04-25T13:17:33.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T13:17:33.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.791+0000 7ff0f0cef640 1 Processor -- start 2024-04-25T13:17:33.792 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.791+0000 7ff0f0cef640 1 -- start start 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0f0cef640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0ec06bb90 0x7ff0ec15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0f0cef640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0f0cef640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff0ec0c99f0 0x7ff0ec0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0f0cef640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ec15bef0 con 0x7ff0ec06bb90 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0f0cef640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ec15b650 con 0x7ff0ec0c99f0 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0f0cef640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ec15b930 con 0x7ff0ec06bf70 2024-04-25T13:17:33.795 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0ec06bb90 0x7ff0ec15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0ec06bb90 0x7ff0ec15af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48752/0 (socket says 172.21.15.155:48752) 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 -- 172.21.15.155:0/1577308233 learned_addr learned my addr 172.21.15.155:0/1577308233 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ead9d640 1 --2- 172.21.15.155:0/1577308233 >> v2:172.21.15.191:3300/0 conn(0x7ff0ec0c99f0 0x7ff0ec0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0e1d9b640 1 --2- 172.21.15.155:0/1577308233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 -- 172.21.15.155:0/1577308233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 msgr2=0x7ff0ec15ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 --2- 172.21.15.155:0/1577308233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 -- 172.21.15.155:0/1577308233 >> v2:172.21.15.191:3300/0 conn(0x7ff0ec0c99f0 msgr2=0x7ff0ec0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 --2- 172.21.15.155:0/1577308233 >> v2:172.21.15.191:3300/0 conn(0x7ff0ec0c99f0 0x7ff0ec0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.792+0000 7ff0ea59c640 1 -- 172.21.15.155:0/1577308233 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec15bc10 con 0x7ff0ec06bb90 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.793+0000 7ff0ea59c640 1 --2- 172.21.15.155:0/1577308233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec15af70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0cc240 tx=0x7ff0dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d8014fa71ed211 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.793+0000 7ff0e9d9b640 1 -- 172.21.15.155:0/1577308233 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc037070 con 0x7ff0ec06bb90 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.793+0000 7ff0e9d9b640 1 -- 172.21.15.155:0/1577308233 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc032440 con 0x7ff0ec06bb90 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.793+0000 7ff0e9d9b640 1 -- 172.21.15.155:0/1577308233 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc032810 con 0x7ff0ec06bb90 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 -- 172.21.15.155:0/1577308233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 msgr2=0x7ff0ec15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/1577308233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec15af70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0cc240 tx=0x7ff0dc02a270 comp rx=0 tx=0).stop 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 -- 172.21.15.155:0/1577308233 shutdown_connections 2024-04-25T13:17:33.797 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/1577308233 >> v2:172.21.15.191:3300/0 conn(0x7ff0ec0c99f0 0x7ff0ec0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/1577308233 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/1577308233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec15af70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 -- 172.21.15.155:0/1577308233 >> 172.21.15.155:0/1577308233 conn(0x7ff0ec074d50 msgr2=0x7ff0ec075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 -- 172.21.15.155:0/1577308233 shutdown_connections 2024-04-25T13:17:33.798 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.794+0000 7ff0f0cef640 1 -- 172.21.15.155:0/1577308233 wait complete. 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.795+0000 7ff0f0cef640 1 Processor -- start 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.795+0000 7ff0f0cef640 1 -- start start 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0f0cef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0f0cef640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0f0cef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0ec0c99f0 0x7ff0ec1f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0f0cef640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec074560 con 0x7ff0ec06bb90 2024-04-25T13:17:33.801 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0f0cef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec15e8e0 con 0x7ff0ec0c99f0 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0f0cef640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ec15f340 con 0x7ff0ec06bf70 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48754/0 (socket says 172.21.15.155:48754) 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 -- 172.21.15.155:0/660579475 learned_addr learned my addr 172.21.15.155:0/660579475 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ead9d640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0ec0c99f0 0x7ff0ec1f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0e1d9b640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 -- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 msgr2=0x7ff0ec15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.802 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 -- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0ec0c99f0 msgr2=0x7ff0ec1f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0ec0c99f0 0x7ff0ec1f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 -- 172.21.15.155:0/660579475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec1f42d0 con 0x7ff0ec06bb90 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.796+0000 7ff0ea59c640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec159e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc000c00 tx=0x7ff0dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.797+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc041020 con 0x7ff0ec06bb90 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.797+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc03d620 con 0x7ff0ec06bb90 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.797+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc037040 con 0x7ff0ec06bb90 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.797+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ec1f45b0 con 0x7ff0ec06bb90 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.797+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ec1f4b70 con 0x7ff0ec06bb90 2024-04-25T13:17:33.803 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.798+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ec154290 con 0x7ff0ec06bb90 2024-04-25T13:17:33.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.798+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0dc044020 con 0x7ff0ec06bb90 2024-04-25T13:17:33.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.798+0000 7ff0e37fe640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff0cc06c920 0x7ff0cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:33.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.798+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff0dc0ac3f0 con 0x7ff0ec06bb90 2024-04-25T13:17:33.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.798+0000 7ff0e1d9b640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff0cc06c920 0x7ff0cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:33.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.799+0000 7ff0e1d9b640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff0cc06c920 0x7ff0cc06ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec15ab40 tx=0x7ff0d4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:33.804 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.803+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0ec154290 con 0x7ff0ec06bb90 2024-04-25T13:17:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.982+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ff0ec068e40 con 0x7ff0cc06c920 2024-04-25T13:17:33.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.982+0000 7ff0e37fe640 1 -- 172.21.15.155:0/660579475 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff0ec068e40 con 0x7ff0cc06c920 2024-04-25T13:17:33.984 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T13:17:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff0cc06c920 msgr2=0x7ff0cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff0cc06c920 0x7ff0cc06ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec15ab40 tx=0x7ff0d4009190 comp rx=0 tx=0).stop 2024-04-25T13:17:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 msgr2=0x7ff0ec159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec159e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc000c00 tx=0x7ff0dc0046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.986 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 shutdown_connections 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0ec0c99f0 0x7ff0ec1f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff0cc06c920 0x7ff0cc06ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0ec06bf70 0x7ff0ec15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 --2- 172.21.15.155:0/660579475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ec06bb90 0x7ff0ec159e00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.984+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 >> 172.21.15.155:0/660579475 conn(0x7ff0ec074d50 msgr2=0x7ff0ec073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.985+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 shutdown_connections 2024-04-25T13:17:33.987 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:33.985+0000 7ff0f0cef640 1 -- 172.21.15.155:0/660579475 wait complete. 2024-04-25T13:17:33.996 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T13:17:33.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:34.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.096+0000 7f8fdecd0640 1 Processor -- start 2024-04-25T13:17:34.097 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.096+0000 7f8fdecd0640 1 -- start start 2024-04-25T13:17:34.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fdecd0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8fd8073a00 0x7f8fd8154db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fdecd0640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f8fd80cbd20 0x7f8fd81552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fdecd0640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fd815e610 con 0x7f8fd8073620 2024-04-25T13:17:34.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fdecd0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd815e8f0 con 0x7f8fd8073a00 2024-04-25T13:17:34.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fdecd0640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f8fd815ebd0 con 0x7f8fd80cbd20 2024-04-25T13:17:34.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8fd8073a00 0x7f8fd8154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8fd8073a00 0x7f8fd8154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48758/0 (socket says 172.21.15.155:48758) 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 -- 172.21.15.155:0/1620853951 learned_addr learned my addr 172.21.15.155:0/1620853951 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 -- 172.21.15.155:0/1620853951 >> v2:172.21.15.191:3300/0 conn(0x7f8fd80cbd20 msgr2=0x7f8fd81552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 --2- 172.21.15.155:0/1620853951 >> v2:172.21.15.191:3300/0 conn(0x7f8fd80cbd20 0x7f8fd81552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 -- 172.21.15.155:0/1620853951 >> v1:172.21.15.191:6789/0 conn(0x7f8fd8073620 legacy=0x7f8fd80cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.097+0000 7f8fd7fff640 1 -- 172.21.15.155:0/1620853951 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd815eeb0 con 0x7f8fd8073a00 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fd7fff640 1 --2- 172.21.15.155:0/1620853951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd8154db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80cc570 tx=0x7f8fc402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7923744628ed0ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fd77fe640 1 -- 172.21.15.155:0/1620853951 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037070 con 0x7f8fd8073a00 2024-04-25T13:17:34.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fd77fe640 1 -- 172.21.15.155:0/1620853951 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc4032440 con 0x7f8fd8073a00 2024-04-25T13:17:34.101 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fd77fe640 1 -- 172.21.15.155:0/1620853951 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4032810 con 0x7f8fd8073a00 2024-04-25T13:17:34.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fdecd0640 1 -- 172.21.15.155:0/1620853951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 msgr2=0x7f8fd8154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fdecd0640 1 --2- 172.21.15.155:0/1620853951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd8154db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80cc570 tx=0x7f8fc402a1a0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fdecd0640 1 -- 172.21.15.155:0/1620853951 shutdown_connections 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fdecd0640 1 --2- 172.21.15.155:0/1620853951 >> v2:172.21.15.191:3300/0 conn(0x7f8fd80cbd20 0x7f8fd81552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fdecd0640 1 --2- 172.21.15.155:0/1620853951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd8154db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.098+0000 7f8fdecd0640 1 -- 172.21.15.155:0/1620853951 >> 172.21.15.155:0/1620853951 conn(0x7f8fd8068120 msgr2=0x7f8fd8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.099+0000 7f8fdecd0640 1 -- 172.21.15.155:0/1620853951 shutdown_connections 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.099+0000 7f8fdecd0640 1 -- 172.21.15.155:0/1620853951 wait complete. 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 Processor -- start 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 -- start start 2024-04-25T13:17:34.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd8073620 0x7f8fd814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd80cbd20 0x7f8fd814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80c9240 con 0x7f8fd8073a00 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd80c90c0 con 0x7f8fd80cbd20 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.100+0000 7f8fdecd0640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd80ce9f0 con 0x7f8fd8073620 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd814f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48770/0 (socket says 172.21.15.155:48770) 2024-04-25T13:17:34.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 -- 172.21.15.155:0/3360358917 learned_addr learned my addr 172.21.15.155:0/3360358917 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fdd26d640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd80cbd20 0x7f8fd814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fdca6c640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd8073620 0x7f8fd814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 -- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd8073620 msgr2=0x7f8fd814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8fd8073620 0x7f8fd814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 -- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd80cbd20 msgr2=0x7f8fd814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8fd80cbd20 0x7f8fd814f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 -- 172.21.15.155:0/3360358917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd80c83b0 con 0x7f8fd8073a00 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd7fff640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd814f200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8fc402a1e0 tx=0x7f8fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.107 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4041070 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc403c870 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037040 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd80cd750 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.101+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd80c5e50 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.102+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fd8068f50 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fc4044070 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fd57fa640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fbc06c920 0x7f8fbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8fc40acac0 con 0x7f8fd8073a00 2024-04-25T13:17:34.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fdca6c640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fbc06c920 0x7f8fbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fd57fa640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f8fbc076330 0x7f8fbc0787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 --> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fc4036e90 con 0x7f8fbc076330 2024-04-25T13:17:34.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8fc40b12c0 con 0x7f8fd8073a00 2024-04-25T13:17:34.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fdd26d640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f8fbc076330 0x7f8fbc0787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.103+0000 7f8fdca6c640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fbc06c920 0x7f8fbc06ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc007fd0 tx=0x7f8fcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.104+0000 7f8fdd26d640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f8fbc076330 0x7f8fbc0787d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.105+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== osd.4 v2:172.21.15.191:6802/2288973653 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fc4036e90 con 0x7f8fbc076330 2024-04-25T13:17:34.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.117+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 --> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8fd80c89c0 con 0x7f8fbc076330 2024-04-25T13:17:34.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fd57fa640 1 -- 172.21.15.155:0/3360358917 <== osd.4 v2:172.21.15.191:6802/2288973653 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8fd80c89c0 con 0x7f8fbc076330 2024-04-25T13:17:34.119 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:34.119 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:34.119 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:34.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f8fbc076330 msgr2=0x7f8fbc0787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdecd0640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.191:6802/2288973653,v1:172.21.15.191:6804/2288973653] conn(0x7f8fbc076330 0x7f8fbc0787d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fbc06c920 msgr2=0x7f8fbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdecd0640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f8fbc06c920 0x7f8fbc06ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc007fd0 tx=0x7f8fcc009040 comp rx=0 tx=0).stop 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 msgr2=0x7f8fd814f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdecd0640 1 --2- 172.21.15.155:0/3360358917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8fd8073a00 0x7f8fd814f200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8fc402a1e0 tx=0x7f8fc40046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.118+0000 7f8fdd26d640 1 -- 172.21.15.155:0/3360358917 reap_dead start 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.119+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 shutdown_connections 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.119+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 >> 172.21.15.155:0/3360358917 conn(0x7f8fd8068120 msgr2=0x7f8fd8152e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.119+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 shutdown_connections 2024-04-25T13:17:34.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.119+0000 7f8fdecd0640 1 -- 172.21.15.155:0/3360358917 wait complete. 2024-04-25T13:17:34.130 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T13:17:34.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effac0e1640 1 Processor -- start 2024-04-25T13:17:34.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effac0e1640 1 -- start start 2024-04-25T13:17:34.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effac0e1640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7effa4074370 0x7effa4164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effac0e1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa415cf40 con 0x7effa40729f0 2024-04-25T13:17:34.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effac0e1640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa4071a50 con 0x7effa40b2c70 2024-04-25T13:17:34.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effac0e1640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7effa40720a0 con 0x7effa4074370 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effa967c640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7effa40729f0 0x7effa40c8b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36612/0 (socket says 172.21.15.155:36612) 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.228+0000 7effa967c640 1 -- 172.21.15.155:0/104201852 learned_addr learned my addr 172.21.15.155:0/104201852 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effaa67e640 1 --2- 172.21.15.155:0/104201852 >> v2:172.21.15.191:3300/0 conn(0x7effa4074370 0x7effa4164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651209017 0 0) 0x7effa415cf40 con 0x7effa40729f0 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff90003520 con 0x7effa40729f0 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2914328838 0 0) 0x7eff90003520 con 0x7effa40729f0 2024-04-25T13:17:34.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 >> v2:172.21.15.191:3300/0 conn(0x7effa4074370 msgr2=0x7effa4164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 --2- 172.21.15.155:0/104201852 >> v2:172.21.15.191:3300/0 conn(0x7effa4074370 0x7effa4164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 >> v1:172.21.15.191:6789/0 conn(0x7effa40b2c70 legacy=0x7effa40722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa4071d30 con 0x7effa40729f0 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7eff94001670 con 0x7effa40729f0 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 >> v1:172.21.15.155:6789/0 conn(0x7effa40729f0 legacy=0x7effa40c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff90004800 0x7eff90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.234 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff900051c0 0x7eff9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7effa40720a0 con 0x7eff900051c0 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7eff9000c070 con 0x7eff900039b0 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7eff9000c270 con 0x7eff90004800 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effaa67e640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff900051c0 0x7eff9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa9e7d640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.229+0000 7effa967c640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff90004800 0x7eff90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 -- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff90004800 msgr2=0x7eff90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7eff90004800 0x7eff90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 -- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900039b0 msgr2=0x7eff90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 -- 172.21.15.155:0/104201852 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff90003520 con 0x7eff900051c0 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 -- 172.21.15.155:0/104201852 reap_dead start 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effaa67e640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff900051c0 0x7eff9000b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009fc0 tx=0x7eff90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4c7aeeb106f67d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c035020 con 0x7eff900051c0 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c003bd0 con 0x7eff900051c0 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.230+0000 7effa8e7b640 1 -- 172.21.15.155:0/104201852 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c009c10 con 0x7eff900051c0 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 -- 172.21.15.155:0/104201852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff900051c0 msgr2=0x7eff9000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff900051c0 0x7eff9000b9c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009fc0 tx=0x7eff90005830 comp rx=0 tx=0).stop 2024-04-25T13:17:34.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 -- 172.21.15.155:0/104201852 shutdown_connections 2024-04-25T13:17:34.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 --2- 172.21.15.155:0/104201852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff900051c0 0x7eff9000b9c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 -- 172.21.15.155:0/104201852 >> 172.21.15.155:0/104201852 conn(0x7effa40c9a70 msgr2=0x7effa40c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 -- 172.21.15.155:0/104201852 shutdown_connections 2024-04-25T13:17:34.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.231+0000 7effac0e1640 1 -- 172.21.15.155:0/104201852 wait complete. 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.232+0000 7effac0e1640 1 Processor -- start 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.232+0000 7effac0e1640 1 -- start start 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effac0e1640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900051c0 0x7effa40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effac0e1640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa40b1d50 0x7effa40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effac0e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 0x7effa40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effac0e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7effa40c8250 con 0x7effa40c53d0 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effac0e1640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7effa40b3050 con 0x7eff900051c0 2024-04-25T13:17:34.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effac0e1640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7effa40c83d0 con 0x7effa40b1d50 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 0x7effa40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 0x7effa40c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48776/0 (socket says 172.21.15.155:48776) 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 -- 172.21.15.155:0/2573058754 learned_addr learned my addr 172.21.15.155:0/2573058754 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effa9e7d640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900051c0 0x7effa40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effa967c640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa40b1d50 0x7effa40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 -- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa40b1d50 msgr2=0x7effa40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa40b1d50 0x7effa40b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 -- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900051c0 msgr2=0x7effa40c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900051c0 0x7effa40c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 -- 172.21.15.155:0/2573058754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa40c5d90 con 0x7effa40c53d0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effa9e7d640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900051c0 0x7effa40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.233+0000 7effaa67e640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 0x7effa40c5850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7eff9c02af10 tx=0x7eff9c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.234+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c035030 con 0x7effa40c53d0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.234+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c043070 con 0x7effa40c53d0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.234+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa41f0ed0 con 0x7effa40c53d0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.234+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c02d070 con 0x7effa40c53d0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.234+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa41f1490 con 0x7effa40c53d0 2024-04-25T13:17:34.242 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.235+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa4068e40 con 0x7effa40c53d0 2024-04-25T13:17:34.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.235+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff9c005d10 con 0x7effa40c53d0 2024-04-25T13:17:34.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.235+0000 7eff9a7fc640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7eff8806c8f0 0x7eff8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.236+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7eff9c0acc90 con 0x7effa40c53d0 2024-04-25T13:17:34.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.236+0000 7effa9e7d640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7eff8806c8f0 0x7eff8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.236+0000 7effa9e7d640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7eff8806c8f0 0x7eff8806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effa0005580 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.243 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.241+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effa40c5d90 con 0x7effa40c53d0 2024-04-25T13:17:34.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.414+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7effa40c70d0 con 0x7eff8806c8f0 2024-04-25T13:17:34.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.415+0000 7eff9a7fc640 1 -- 172.21.15.155:0/2573058754 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7effa40c70d0 con 0x7eff8806c8f0 2024-04-25T13:17:34.416 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T13:17:34.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7eff8806c8f0 msgr2=0x7eff8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7eff8806c8f0 0x7eff8806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effa0005580 tx=0x7effa0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:34.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 msgr2=0x7effa40c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 0x7effa40c5850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7eff9c02af10 tx=0x7eff9c009750 comp rx=0 tx=0).stop 2024-04-25T13:17:34.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 shutdown_connections 2024-04-25T13:17:34.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7effa40c53d0 0x7effa40c5850 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7eff8806c8f0 0x7eff8806edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7effa40b1d50 0x7effa40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 --2- 172.21.15.155:0/2573058754 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff900051c0 0x7effa40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.416+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 >> 172.21.15.155:0/2573058754 conn(0x7effa40c9a70 msgr2=0x7effa415a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.417+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 shutdown_connections 2024-04-25T13:17:34.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.417+0000 7effac0e1640 1 -- 172.21.15.155:0/2573058754 wait complete. 2024-04-25T13:17:34.428 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T13:17:34.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:34.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.529+0000 7fec4640b640 1 Processor -- start 2024-04-25T13:17:34.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.529+0000 7fec4640b640 1 -- start start 2024-04-25T13:17:34.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec4640b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec400742e0 0x7fec40071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec4640b640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fec400c79e0 0x7fec4006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec4640b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec401535c0 con 0x7fec40072900 2024-04-25T13:17:34.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec4640b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fec400b2b10 con 0x7fec400742e0 2024-04-25T13:17:34.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec4640b640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fec4006e020 con 0x7fec400c79e0 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec400742e0 0x7fec40071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fec400742e0 0x7fec40071a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48790/0 (socket says 172.21.15.155:48790) 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3ffff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fec40072900 0x7fec4015c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36628/0 (socket says 172.21.15.155:36628) 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 -- 172.21.15.155:0/2433487265 learned_addr learned my addr 172.21.15.155:0/2433487265 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec449a8640 1 --2- 172.21.15.155:0/2433487265 >> v2:172.21.15.191:3300/0 conn(0x7fec400c79e0 0x7fec4006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 -- 172.21.15.155:0/2433487265 >> v2:172.21.15.191:3300/0 conn(0x7fec400c79e0 msgr2=0x7fec4006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 --2- 172.21.15.155:0/2433487265 >> v2:172.21.15.191:3300/0 conn(0x7fec400c79e0 0x7fec4006e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 -- 172.21.15.155:0/2433487265 >> v1:172.21.15.155:6789/0 conn(0x7fec40072900 legacy=0x7fec4015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 -- 172.21.15.155:0/2433487265 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec400b2d60 con 0x7fec400742e0 2024-04-25T13:17:34.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3f7fe640 1 --2- 172.21.15.155:0/2433487265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400742e0 0x7fec40071a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec400caba0 tx=0x7fec3402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671c8d7f6aaad75e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3effd640 1 -- 172.21.15.155:0/2433487265 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34037070 con 0x7fec400742e0 2024-04-25T13:17:34.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3effd640 1 -- 172.21.15.155:0/2433487265 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3402ae50 con 0x7fec400742e0 2024-04-25T13:17:34.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.531+0000 7fec3effd640 1 -- 172.21.15.155:0/2433487265 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34032860 con 0x7fec400742e0 2024-04-25T13:17:34.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 -- 172.21.15.155:0/2433487265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400742e0 msgr2=0x7fec40071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 --2- 172.21.15.155:0/2433487265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400742e0 0x7fec40071a00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec400caba0 tx=0x7fec3402a300 comp rx=0 tx=0).stop 2024-04-25T13:17:34.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 -- 172.21.15.155:0/2433487265 shutdown_connections 2024-04-25T13:17:34.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 --2- 172.21.15.155:0/2433487265 >> v2:172.21.15.191:3300/0 conn(0x7fec400c79e0 0x7fec4006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 --2- 172.21.15.155:0/2433487265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400742e0 0x7fec40071a00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 -- 172.21.15.155:0/2433487265 >> 172.21.15.155:0/2433487265 conn(0x7fec4006f510 msgr2=0x7fec4006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 -- 172.21.15.155:0/2433487265 shutdown_connections 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.532+0000 7fec4640b640 1 -- 172.21.15.155:0/2433487265 wait complete. 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.533+0000 7fec4640b640 1 Processor -- start 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.533+0000 7fec4640b640 1 -- start start 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec40072900 0x7fec4014d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec400742e0 0x7fec401eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400c79e0 0x7fec401ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec4006dcb0 con 0x7fec400c79e0 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fec4006d9d0 con 0x7fec40072900 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fec40072ce0 con 0x7fec400742e0 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400c79e0 0x7fec401ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400c79e0 0x7fec401ef440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48806/0 (socket says 172.21.15.155:48806) 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 -- 172.21.15.155:0/894694431 learned_addr learned my addr 172.21.15.155:0/894694431 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec3ffff640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec40072900 0x7fec4014d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec3f7fe640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec400742e0 0x7fec401eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 -- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec400742e0 msgr2=0x7fec401eef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec400742e0 0x7fec401eef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 -- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec40072900 msgr2=0x7fec4014d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fec40072900 0x7fec4014d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 -- 172.21.15.155:0/894694431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec40157f30 con 0x7fec400c79e0 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec3f7fe640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fec400742e0 0x7fec401eef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec449a8640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400c79e0 0x7fec401ef440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec38009fd0 tx=0x7fec3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38014420 con 0x7fec400c79e0 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec38019070 con 0x7fec400c79e0 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec40151720 con 0x7fec400c79e0 2024-04-25T13:17:34.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38014800 con 0x7fec400c79e0 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.534+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4014e5e0 con 0x7fec400c79e0 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.535+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec401eeae0 con 0x7fec400c79e0 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec380149a0 con 0x7fec400c79e0 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3cff9640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fec2c06c8f0 0x7fec2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fec3808c860 con 0x7fec400c79e0 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3ffff640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fec2c06c8f0 0x7fec2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3cff9640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7fec2c076300 0x7fec2c0787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 --> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec38006b90 con 0x7fec2c076300 2024-04-25T13:17:34.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fec380912c0 con 0x7fec400c79e0 2024-04-25T13:17:34.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.536+0000 7fec3ffff640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fec2c06c8f0 0x7fec2c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec30000f60 tx=0x7fec30007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.537+0000 7fec3f7fe640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7fec2c076300 0x7fec2c0787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.537+0000 7fec3f7fe640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7fec2c076300 0x7fec2c0787a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.538+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== osd.5 v2:172.21.15.191:6800/2170630618 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec38006b90 con 0x7fec2c076300 2024-04-25T13:17:34.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.550+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 --> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec400cb4f0 con 0x7fec2c076300 2024-04-25T13:17:34.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec3cff9640 1 -- 172.21.15.155:0/894694431 <== osd.5 v2:172.21.15.191:6800/2170630618 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec400cb4f0 con 0x7fec2c076300 2024-04-25T13:17:34.552 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:34.552 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:34.552 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:34.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7fec2c076300 msgr2=0x7fec2c0787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.191:6800/2170630618,v1:172.21.15.191:6801/2170630618] conn(0x7fec2c076300 0x7fec2c0787a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fec2c06c8f0 msgr2=0x7fec2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fec2c06c8f0 0x7fec2c06edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec30000f60 tx=0x7fec30007cc0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400c79e0 msgr2=0x7fec401ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 --2- 172.21.15.155:0/894694431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec400c79e0 0x7fec401ef440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec38009fd0 tx=0x7fec3800e4b0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec449a8640 1 -- 172.21.15.155:0/894694431 reap_dead start 2024-04-25T13:17:34.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 shutdown_connections 2024-04-25T13:17:34.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.551+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 >> 172.21.15.155:0/894694431 conn(0x7fec4006f510 msgr2=0x7fec400cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.552+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 shutdown_connections 2024-04-25T13:17:34.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.552+0000 7fec4640b640 1 -- 172.21.15.155:0/894694431 wait complete. 2024-04-25T13:17:34.563 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T13:17:34.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 Processor -- start 2024-04-25T13:17:34.662 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 -- start start 2024-04-25T13:17:34.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fa55806bb90 0x7fa55815af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5580c99f0 0x7fa5580c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55815bef0 con 0x7fa55806bf70 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa55815f510 con 0x7fa5580c99f0 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55fdbf640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fa55815b650 con 0x7fa55806bb90 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55e35c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5580c99f0 0x7fa5580c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55e35c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5580c99f0 0x7fa5580c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48822/0 (socket says 172.21.15.155:48822) 2024-04-25T13:17:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.661+0000 7fa55e35c640 1 -- 172.21.15.155:0/1441435114 learned_addr learned my addr 172.21.15.155:0/1441435114 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55db5b640 1 --2- 172.21.15.155:0/1441435114 >> v2:172.21.15.191:3300/0 conn(0x7fa55806bb90 0x7fa55815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55e35c640 1 -- 172.21.15.155:0/1441435114 >> v2:172.21.15.191:3300/0 conn(0x7fa55806bb90 msgr2=0x7fa55815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55e35c640 1 --2- 172.21.15.155:0/1441435114 >> v2:172.21.15.191:3300/0 conn(0x7fa55806bb90 0x7fa55815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55e35c640 1 -- 172.21.15.155:0/1441435114 >> v1:172.21.15.191:6789/0 conn(0x7fa55806bf70 legacy=0x7fa55815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55e35c640 1 -- 172.21.15.155:0/1441435114 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55815b930 con 0x7fa5580c99f0 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55db5b640 1 --2- 172.21.15.155:0/1441435114 >> v2:172.21.15.191:3300/0 conn(0x7fa55806bb90 0x7fa55815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.662+0000 7fa55e35c640 1 --2- 172.21.15.155:0/1441435114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580c9e60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa55806db00 tx=0x7fa54802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add7fde2c75d0a7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55cb59640 1 -- 172.21.15.155:0/1441435114 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548037070 con 0x7fa5580c99f0 2024-04-25T13:17:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55cb59640 1 -- 172.21.15.155:0/1441435114 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54802ae50 con 0x7fa5580c99f0 2024-04-25T13:17:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55cb59640 1 -- 172.21.15.155:0/1441435114 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548032860 con 0x7fa5580c99f0 2024-04-25T13:17:34.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 -- 172.21.15.155:0/1441435114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 msgr2=0x7fa5580c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/1441435114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580c9e60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa55806db00 tx=0x7fa54802a300 comp rx=0 tx=0).stop 2024-04-25T13:17:34.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 -- 172.21.15.155:0/1441435114 shutdown_connections 2024-04-25T13:17:34.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/1441435114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580c9e60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.669 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/1441435114 >> v2:172.21.15.191:3300/0 conn(0x7fa55806bb90 0x7fa55815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 -- 172.21.15.155:0/1441435114 >> 172.21.15.155:0/1441435114 conn(0x7fa558074d50 msgr2=0x7fa558075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 -- 172.21.15.155:0/1441435114 shutdown_connections 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.663+0000 7fa55fdbf640 1 -- 172.21.15.155:0/1441435114 wait complete. 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.664+0000 7fa55fdbf640 1 Processor -- start 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.664+0000 7fa55fdbf640 1 -- start start 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55fdbf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55806bb90 0x7fa5580ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55fdbf640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55806bf70 0x7fa5580cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.670 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55fdbf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55fdbf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815e8e0 con 0x7fa5580c99f0 2024-04-25T13:17:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55fdbf640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fa55815e600 con 0x7fa55806bb90 2024-04-25T13:17:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55fdbf640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fa558074560 con 0x7fa55806bf70 2024-04-25T13:17:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48836/0 (socket says 172.21.15.155:48836) 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 -- 172.21.15.155:0/4255451734 learned_addr learned my addr 172.21.15.155:0/4255451734 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 -- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55806bf70 msgr2=0x7fa5580cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55806bf70 0x7fa5580cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 -- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55806bb90 msgr2=0x7fa5580ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55db5b640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55806bb90 0x7fa5580ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55806bb90 0x7fa5580ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.665+0000 7fa55e35c640 1 -- 172.21.15.155:0/4255451734 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa558158b30 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.666+0000 7fa55e35c640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580cdc50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5480090b0 tx=0x7fa5480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.666+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548041070 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.666+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54803c660 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.666+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548037040 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.666+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55814c300 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.666+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55814c8c0 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.667+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5580cbd60 con 0x7fa5580c99f0 2024-04-25T13:17:34.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.667+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa548044070 con 0x7fa5580c99f0 2024-04-25T13:17:34.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.667+0000 7fa5567fc640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa54406c8f0 0x7fa54406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.668+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa5480acb40 con 0x7fa5580c99f0 2024-04-25T13:17:34.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.668+0000 7fa55db5b640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa54406c8f0 0x7fa54406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.668+0000 7fa55db5b640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa54406c8f0 0x7fa54406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa550009ed0 tx=0x7fa55000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.676 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.673+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5580cbd60 con 0x7fa5580c99f0 2024-04-25T13:17:34.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.853+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa5581547a0 con 0x7fa54406c8f0 2024-04-25T13:17:34.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.853+0000 7fa5567fc640 1 -- 172.21.15.155:0/4255451734 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa550009ae0 con 0x7fa54406c8f0 2024-04-25T13:17:34.855 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa54406c8f0 msgr2=0x7fa54406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa54406c8f0 0x7fa54406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa550009ed0 tx=0x7fa55000b040 comp rx=0 tx=0).stop 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 msgr2=0x7fa5580cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580cdc50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5480090b0 tx=0x7fa5480046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 shutdown_connections 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5580c99f0 0x7fa5580cdc50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fa54406c8f0 0x7fa54406edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fa55806bf70 0x7fa5580cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 --2- 172.21.15.155:0/4255451734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa55806bb90 0x7fa5580ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 >> 172.21.15.155:0/4255451734 conn(0x7fa558074d50 msgr2=0x7fa558154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 shutdown_connections 2024-04-25T13:17:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.855+0000 7fa55fdbf640 1 -- 172.21.15.155:0/4255451734 wait complete. 2024-04-25T13:17:34.867 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T13:17:34.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:34.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 Processor -- start 2024-04-25T13:17:34.970 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 -- start start 2024-04-25T13:17:34.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f325c1551f0 0x7f325c06e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f325c0c30b0 0x7f325c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325c0c7f90 con 0x7f325c1555d0 2024-04-25T13:17:34.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f325c15c030 con 0x7f325c1551f0 2024-04-25T13:17:34.972 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f32641a2640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f325c0c2720 con 0x7f325c0c30b0 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f325c1551f0 0x7f325c06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f325c1551f0 0x7f325c06e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48840/0 (socket says 172.21.15.155:48840) 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 -- 172.21.15.155:0/2189523752 learned_addr learned my addr 172.21.15.155:0/2189523752 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f326273f640 1 --2- 172.21.15.155:0/2189523752 >> v2:172.21.15.191:3300/0 conn(0x7f325c0c30b0 0x7f325c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 -- 172.21.15.155:0/2189523752 >> v2:172.21.15.191:3300/0 conn(0x7f325c0c30b0 msgr2=0x7f325c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 --2- 172.21.15.155:0/2189523752 >> v2:172.21.15.191:3300/0 conn(0x7f325c0c30b0 0x7f325c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 -- 172.21.15.155:0/2189523752 >> v1:172.21.15.155:6789/0 conn(0x7f325c1555d0 legacy=0x7f325c0c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.973 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.969+0000 7f3261f3e640 1 -- 172.21.15.155:0/2189523752 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c15bad0 con 0x7f325c1551f0 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.970+0000 7f3261f3e640 1 --2- 172.21.15.155:0/2189523752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c1551f0 0x7f325c06e050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f325c15bca0 tx=0x7f325802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfb1c5c601c368 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.970+0000 7f3260f3c640 1 -- 172.21.15.155:0/2189523752 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258037070 con 0x7f325c1551f0 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.970+0000 7f3260f3c640 1 -- 172.21.15.155:0/2189523752 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325802ae50 con 0x7f325c1551f0 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.970+0000 7f3260f3c640 1 -- 172.21.15.155:0/2189523752 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258032860 con 0x7f325c1551f0 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 -- 172.21.15.155:0/2189523752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c1551f0 msgr2=0x7f325c06e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 --2- 172.21.15.155:0/2189523752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c1551f0 0x7f325c06e050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f325c15bca0 tx=0x7f325802a300 comp rx=0 tx=0).stop 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 -- 172.21.15.155:0/2189523752 shutdown_connections 2024-04-25T13:17:34.974 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 --2- 172.21.15.155:0/2189523752 >> v2:172.21.15.191:3300/0 conn(0x7f325c0c30b0 0x7f325c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 --2- 172.21.15.155:0/2189523752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c1551f0 0x7f325c06e050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 -- 172.21.15.155:0/2189523752 >> 172.21.15.155:0/2189523752 conn(0x7f325c06f510 msgr2=0x7f325c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 -- 172.21.15.155:0/2189523752 shutdown_connections 2024-04-25T13:17:34.975 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.971+0000 7f32641a2640 1 -- 172.21.15.155:0/2189523752 wait complete. 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.972+0000 7f32641a2640 1 Processor -- start 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.972+0000 7f32641a2640 1 -- start start 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f325c1551f0 0x7f325c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c0ca060 0x7f325c140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f325c14a380 0x7f325c14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0c2440 con 0x7f325c0ca060 2024-04-25T13:17:34.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f325c0c21a0 con 0x7f325c1551f0 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f325c068420 con 0x7f325c14a380 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c0ca060 0x7f325c140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c0ca060 0x7f325c140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48852/0 (socket says 172.21.15.155:48852) 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 -- 172.21.15.155:0/3376762098 learned_addr learned my addr 172.21.15.155:0/3376762098 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f3261f3e640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f325c1551f0 0x7f325c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326273f640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f325c14a380 0x7f325c14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 -- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f325c14a380 msgr2=0x7f325c14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f325c14a380 0x7f325c14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 -- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f325c1551f0 msgr2=0x7f325c0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f325c1551f0 0x7f325c0c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 -- 172.21.15.155:0/3376762098 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c0caf80 con 0x7f325c0ca060 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f3261f3e640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f325c1551f0 0x7f325c0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f326173d640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c0ca060 0x7f325c140cd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c400 tx=0x7f324c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c017070 con 0x7f325c0ca060 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c0052d0 con 0x7f325c0ca060 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324c003830 con 0x7f325c0ca060 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325c0cb260 con 0x7f325c0ca060 2024-04-25T13:17:34.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.973+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325c1447c0 con 0x7f325c0ca060 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.974+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f325c068f50 con 0x7f325c0ca060 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f324c01a070 con 0x7f325c0ca060 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f32527fc640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f324006c920 0x7f324006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f324c08b1c0 con 0x7f325c0ca060 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f3261f3e640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f324006c920 0x7f324006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f32527fc640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f3240076330 0x7f32400787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 --> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3240078ea0 con 0x7f3240076330 2024-04-25T13:17:34.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.975+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f324c092050 con 0x7f325c0ca060 2024-04-25T13:17:34.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.976+0000 7f326273f640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f3240076330 0x7f32400787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:34.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.976+0000 7f3261f3e640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f324006c920 0x7f324006ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3258034000 tx=0x7f325802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.976+0000 7f326273f640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f3240076330 0x7f32400787d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:34.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.977+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== osd.6 v2:172.21.15.191:6824/1440480290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3240078ea0 con 0x7f3240076330 2024-04-25T13:17:34.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.990+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 --> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f325c0b2d40 con 0x7f3240076330 2024-04-25T13:17:34.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.990+0000 7f32527fc640 1 -- 172.21.15.155:0/3376762098 <== osd.6 v2:172.21.15.191:6824/1440480290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f325c0b2d40 con 0x7f3240076330 2024-04-25T13:17:34.992 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:34.992 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:34.992 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:34.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f3240076330 msgr2=0x7f32400787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.191:6824/1440480290,v1:172.21.15.191:6825/1440480290] conn(0x7f3240076330 0x7f32400787d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f324006c920 msgr2=0x7f324006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f324006c920 0x7f324006ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3258034000 tx=0x7f325802e000 comp rx=0 tx=0).stop 2024-04-25T13:17:34.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c0ca060 msgr2=0x7f325c140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:34.993 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 --2- 172.21.15.155:0/3376762098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f325c0ca060 0x7f325c140cd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c400 tx=0x7f324c00c8c0 comp rx=0 tx=0).stop 2024-04-25T13:17:34.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f326273f640 1 -- 172.21.15.155:0/3376762098 reap_dead start 2024-04-25T13:17:34.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 shutdown_connections 2024-04-25T13:17:34.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 >> 172.21.15.155:0/3376762098 conn(0x7f325c06f510 msgr2=0x7f325c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:34.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 shutdown_connections 2024-04-25T13:17:34.994 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:34.991+0000 7f32641a2640 1 -- 172.21.15.155:0/3376762098 wait complete. 2024-04-25T13:17:35.002 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T13:17:35.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.099+0000 7f879d00b640 1 Processor -- start 2024-04-25T13:17:35.100 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.099+0000 7f879d00b640 1 -- start start 2024-04-25T13:17:35.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f879d00b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798151ea0 0x7f87980c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f879d00b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879815b610 con 0x7f87980c3cb0 2024-04-25T13:17:35.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f879d00b640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879806e6f0 con 0x7f8798152280 2024-04-25T13:17:35.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f879d00b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f879806f300 con 0x7f8798151ea0 2024-04-25T13:17:35.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f879759e640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f87980c3cb0 0x7f8798162660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:36660/0 (socket says 172.21.15.155:36660) 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f879759e640 1 -- 172.21.15.155:0/3558268481 learned_addr learned my addr 172.21.15.155:0/3558268481 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8796d9d640 1 --2- 172.21.15.155:0/3558268481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798151ea0 0x7f87980c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339695625 0 0) 0x7f879815b610 con 0x7f87980c3cb0 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8780003520 con 0x7f87980c3cb0 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 <== mon.1 v1:172.21.15.191:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769576983 0 0) 0x7f879806e6f0 con 0x7f8798152280 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 --> v1:172.21.15.191:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f879815b610 con 0x7f8798152280 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061727615 0 0) 0x7f8780003520 con 0x7f87980c3cb0 2024-04-25T13:17:35.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.100+0000 7f8796d9d640 1 -- 172.21.15.155:0/3558268481 >> v1:172.21.15.191:6789/0 conn(0x7f8798152280 legacy=0x7f87981591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.101+0000 7f8796d9d640 1 -- 172.21.15.155:0/3558268481 >> v1:172.21.15.155:6789/0 conn(0x7f87980c3cb0 legacy=0x7f8798162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.101+0000 7f8796d9d640 1 -- 172.21.15.155:0/3558268481 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879806e9d0 con 0x7f8798151ea0 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.101+0000 7f8796d9d640 1 --2- 172.21.15.155:0/3558268481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798151ea0 0x7f87980c7f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8788009dc0 tx=0x7f878802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fffdf1aaf21b148 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.101+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 <== mon.2 v2:172.21.15.191:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790001670 con 0x7f8798151ea0 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.101+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 <== mon.2 v2:172.21.15.191:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878802ae50 con 0x7f8798151ea0 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.101+0000 7f8795d9b640 1 -- 172.21.15.155:0/3558268481 <== mon.2 v2:172.21.15.191:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788007740 con 0x7f8798151ea0 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 -- 172.21.15.155:0/3558268481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798151ea0 msgr2=0x7f87980c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 --2- 172.21.15.155:0/3558268481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798151ea0 0x7f87980c7f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8788009dc0 tx=0x7f878802a6f0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 -- 172.21.15.155:0/3558268481 shutdown_connections 2024-04-25T13:17:35.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 --2- 172.21.15.155:0/3558268481 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798151ea0 0x7f87980c7f10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 -- 172.21.15.155:0/3558268481 >> 172.21.15.155:0/3558268481 conn(0x7f87980c8f00 msgr2=0x7f87980c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 -- 172.21.15.155:0/3558268481 shutdown_connections 2024-04-25T13:17:35.106 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.102+0000 7f879d00b640 1 -- 172.21.15.155:0/3558268481 wait complete. 2024-04-25T13:17:35.108 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.103+0000 7f879d00b640 1 Processor -- start 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.103+0000 7f879d00b640 1 -- start start 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879d00b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87980c3cb0 0x7f87981edea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879d00b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 0x7f8798073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879d00b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798155460 0x7f879814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879d00b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f87980c8cb0 con 0x7f8798151ea0 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879d00b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f879806ef90 con 0x7f87980c3cb0 2024-04-25T13:17:35.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879d00b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f879815b2d0 con 0x7f8798155460 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 0x7f8798073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 0x7f8798073980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48854/0 (socket says 172.21.15.155:48854) 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879659c640 1 -- 172.21.15.155:0/3045395728 learned_addr learned my addr 172.21.15.155:0/3045395728 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f8796d9d640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87980c3cb0 0x7f87981edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879759e640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798155460 0x7f879814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.104+0000 7f879659c640 1 -- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798155460 msgr2=0x7f879814e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879659c640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798155460 0x7f879814e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.110 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879659c640 1 -- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87980c3cb0 msgr2=0x7f87981edea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879659c640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87980c3cb0 0x7f87981edea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879659c640 1 -- 172.21.15.155:0/3045395728 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8798151190 con 0x7f8798151ea0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879659c640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 0x7f8798073980 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c460 tx=0x7f878c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c0052d0 con 0x7f8798151ea0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c005490 con 0x7f8798151ea0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c012870 con 0x7f8798151ea0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879814f540 con 0x7f8798151ea0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.105+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879814fb00 con 0x7f8798151ea0 2024-04-25T13:17:35.111 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.106+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8798068e40 con 0x7f8798151ea0 2024-04-25T13:17:35.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.106+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f878c012a10 con 0x7f8798151ea0 2024-04-25T13:17:35.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.107+0000 7f877f7fe640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f878406c8f0 0x7f878406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.107+0000 7f8796d9d640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f878406c8f0 0x7f878406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.107+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f878c08ba70 con 0x7f8798151ea0 2024-04-25T13:17:35.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.107+0000 7f8796d9d640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f878406c8f0 0x7f878406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8788034000 tx=0x7f878802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.112 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.112+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f878c0593d0 con 0x7f8798151ea0 2024-04-25T13:17:35.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.290+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f8798072100 con 0x7f878406c8f0 2024-04-25T13:17:35.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.290+0000 7f877f7fe640 1 -- 172.21.15.155:0/3045395728 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8798072100 con 0x7f878406c8f0 2024-04-25T13:17:35.292 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T13:17:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f878406c8f0 msgr2=0x7f878406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f878406c8f0 0x7f878406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8788034000 tx=0x7f878802f000 comp rx=0 tx=0).stop 2024-04-25T13:17:35.294 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 msgr2=0x7f8798073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 0x7f8798073980 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c460 tx=0x7f878c00c920 comp rx=0 tx=0).stop 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 shutdown_connections 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f878406c8f0 0x7f878406edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f8798155460 0x7f879814e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8798151ea0 0x7f8798073980 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 --2- 172.21.15.155:0/3045395728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f87980c3cb0 0x7f87981edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.292+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 >> 172.21.15.155:0/3045395728 conn(0x7f87980c8f00 msgr2=0x7f879814d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.293+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 shutdown_connections 2024-04-25T13:17:35.295 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.293+0000 7f879d00b640 1 -- 172.21.15.155:0/3045395728 wait complete. 2024-04-25T13:17:35.304 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T13:17:35.305 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:17:35.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 Processor -- start 2024-04-25T13:17:35.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 -- start start 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0e8073620 0x7fb0e80cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073a00 0x7fb0e8154db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e815e610 con 0x7fb0e80cbd20 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e815e8f0 con 0x7fb0e8073620 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.405+0000 7fb0ef66b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e815ebd0 con 0x7fb0e8073a00 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0e8073620 0x7fb0e80cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb0e8073620 0x7fb0e80cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48866/0 (socket says 172.21.15.155:48866) 2024-04-25T13:17:35.408 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 -- 172.21.15.155:0/37211754 learned_addr learned my addr 172.21.15.155:0/37211754 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ecc06640 1 --2- 172.21.15.155:0/37211754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073a00 0x7fb0e8154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 -- 172.21.15.155:0/37211754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073a00 msgr2=0x7fb0e8154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 --2- 172.21.15.155:0/37211754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073a00 0x7fb0e8154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 -- 172.21.15.155:0/37211754 >> v1:172.21.15.191:6789/0 conn(0x7fb0e80cbd20 legacy=0x7fb0e80ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.406+0000 7fb0ed407640 1 -- 172.21.15.155:0/37211754 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e815eeb0 con 0x7fb0e8073620 2024-04-25T13:17:35.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ed407640 1 --2- 172.21.15.155:0/37211754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073620 0x7fb0e80cb550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009870 tx=0x7fb0e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108915ce6dc94bce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0dbfff640 1 -- 172.21.15.155:0/37211754 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4037070 con 0x7fb0e8073620 2024-04-25T13:17:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0dbfff640 1 -- 172.21.15.155:0/37211754 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e4032440 con 0x7fb0e8073620 2024-04-25T13:17:35.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0dbfff640 1 -- 172.21.15.155:0/37211754 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4032810 con 0x7fb0e8073620 2024-04-25T13:17:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 -- 172.21.15.155:0/37211754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073620 msgr2=0x7fb0e80cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 --2- 172.21.15.155:0/37211754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073620 0x7fb0e80cb550 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009870 tx=0x7fb0e402a270 comp rx=0 tx=0).stop 2024-04-25T13:17:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 -- 172.21.15.155:0/37211754 shutdown_connections 2024-04-25T13:17:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 --2- 172.21.15.155:0/37211754 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073a00 0x7fb0e8154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 --2- 172.21.15.155:0/37211754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073620 0x7fb0e80cb550 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 -- 172.21.15.155:0/37211754 >> 172.21.15.155:0/37211754 conn(0x7fb0e8068120 msgr2=0x7fb0e8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 -- 172.21.15.155:0/37211754 shutdown_connections 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 -- 172.21.15.155:0/37211754 wait complete. 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.408+0000 7fb0ef66b640 1 Processor -- start 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 -- start start 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073620 0x7fb0e815be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073a00 0x7fb0e815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e80cbd20 0x7fb0e80c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e80c90c0 con 0x7fb0e8073a00 2024-04-25T13:17:35.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e80cba90 con 0x7fb0e80cbd20 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e80c9240 con 0x7fb0e8073620 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073a00 0x7fb0e815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073a00 0x7fb0e815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48878/0 (socket says 172.21.15.155:48878) 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 -- 172.21.15.155:0/1176269421 learned_addr learned my addr 172.21.15.155:0/1176269421 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0edc08640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e80cbd20 0x7fb0e80c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ed407640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073620 0x7fb0e815be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 -- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073620 msgr2=0x7fb0e815be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fb0e8073620 0x7fb0e815be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 -- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e80cbd20 msgr2=0x7fb0e80c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e80cbd20 0x7fb0e80c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 -- 172.21.15.155:0/1176269421 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e815cfa0 con 0x7fb0e8073a00 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0edc08640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb0e80cbd20 0x7fb0e80c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ecc06640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073a00 0x7fb0e815dc60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00e9b0 tx=0x7fb0dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc017070 con 0x7fb0e8073a00 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00c9a0 con 0x7fb0e8073a00 2024-04-25T13:17:35.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e80cd070 con 0x7fb0e8073a00 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00cd90 con 0x7fb0e8073a00 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.410+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e80cd630 con 0x7fb0e8073a00 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.412+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0e8068f50 con 0x7fb0e8073a00 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.412+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0dc01a070 con 0x7fb0e8073a00 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0d9ffb640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb0cc06c920 0x7fb0cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb0dc08c290 con 0x7fb0e8073a00 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0ed407640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb0cc06c920 0x7fb0cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0d9ffb640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7fb0cc076330 0x7fb0cc0787d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 --> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0dc016ec0 con 0x7fb0cc076330 2024-04-25T13:17:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0dc093050 con 0x7fb0e8073a00 2024-04-25T13:17:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0ed407640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb0cc06c920 0x7fb0cc06ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4034000 tx=0x7fb0e402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.413+0000 7fb0edc08640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7fb0cc076330 0x7fb0cc0787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.414+0000 7fb0edc08640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7fb0cc076330 0x7fb0cc0787d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.414+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== osd.7 v2:172.21.15.191:6816/3056123415 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb0dc016ec0 con 0x7fb0cc076330 2024-04-25T13:17:35.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.428+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 --> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb0e80c9740 con 0x7fb0cc076330 2024-04-25T13:17:35.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.428+0000 7fb0d9ffb640 1 -- 172.21.15.155:0/1176269421 <== osd.7 v2:172.21.15.191:6816/3056123415 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb0e80c9740 con 0x7fb0cc076330 2024-04-25T13:17:35.428 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-04-25T13:17:35.429 INFO:teuthology.orchestra.run.smithi155.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:17:35.429 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.428+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7fb0cc076330 msgr2=0x7fb0cc0787d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.428+0000 7fb0ef66b640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.191:6816/3056123415,v1:172.21.15.191:6817/3056123415] conn(0x7fb0cc076330 0x7fb0cc0787d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb0cc06c920 msgr2=0x7fb0cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fb0cc06c920 0x7fb0cc06ede0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4034000 tx=0x7fb0e402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073a00 msgr2=0x7fb0e815dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 --2- 172.21.15.155:0/1176269421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0e8073a00 0x7fb0e815dc60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00e9b0 tx=0x7fb0dc00ee70 comp rx=0 tx=0).stop 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0edc08640 1 -- 172.21.15.155:0/1176269421 reap_dead start 2024-04-25T13:17:35.430 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 shutdown_connections 2024-04-25T13:17:35.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 >> 172.21.15.155:0/1176269421 conn(0x7fb0e8068120 msgr2=0x7fb0e814f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 shutdown_connections 2024-04-25T13:17:35.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.429+0000 7fb0ef66b640 1 -- 172.21.15.155:0/1176269421 wait complete. 2024-04-25T13:17:35.439 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T13:17:35.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.537+0000 7fcedb662640 1 Processor -- start 2024-04-25T13:17:35.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.537+0000 7fcedb662640 1 -- start start 2024-04-25T13:17:35.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fcedb662640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fced4151ea0 0x7fced40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fcedb662640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced40c3cb0 0x7fced40c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fcedb662640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fced415b610 con 0x7fced4152280 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fcedb662640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fced406f300 con 0x7fced4151ea0 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fcedb662640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fced406e6f0 con 0x7fced40c3cb0 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fced93fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fced4151ea0 0x7fced40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fced93fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fced4151ea0 0x7fced40c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48884/0 (socket says 172.21.15.155:48884) 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.538+0000 7fced93fe640 1 -- 172.21.15.155:0/3359202330 learned_addr learned my addr 172.21.15.155:0/3359202330 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.540 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced9bff640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced40c3cb0 0x7fced40c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced93fe640 1 -- 172.21.15.155:0/3359202330 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced40c3cb0 msgr2=0x7fced40c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced93fe640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced40c3cb0 0x7fced40c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced93fe640 1 -- 172.21.15.155:0/3359202330 >> v1:172.21.15.155:6789/0 conn(0x7fced4152280 legacy=0x7fced41591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced93fe640 1 -- 172.21.15.155:0/3359202330 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced406e9d0 con 0x7fced4151ea0 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced9bff640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced40c3cb0 0x7fced40c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.539+0000 7fced93fe640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced4151ea0 0x7fced40c7f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fced000bb10 tx=0x7fced002c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fb1fed83ef260c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcecbfff640 1 -- 172.21.15.155:0/3359202330 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0035070 con 0x7fced4151ea0 2024-04-25T13:17:35.541 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcecbfff640 1 -- 172.21.15.155:0/3359202330 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced0031610 con 0x7fced4151ea0 2024-04-25T13:17:35.542 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcecbfff640 1 -- 172.21.15.155:0/3359202330 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00319e0 con 0x7fced4151ea0 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 -- 172.21.15.155:0/3359202330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced4151ea0 msgr2=0x7fced40c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced4151ea0 0x7fced40c7f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fced000bb10 tx=0x7fced002c9b0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 -- 172.21.15.155:0/3359202330 shutdown_connections 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced40c3cb0 0x7fced40c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 --2- 172.21.15.155:0/3359202330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced4151ea0 0x7fced40c7f10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 -- 172.21.15.155:0/3359202330 >> 172.21.15.155:0/3359202330 conn(0x7fced40c8f00 msgr2=0x7fced40c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 -- 172.21.15.155:0/3359202330 shutdown_connections 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.540+0000 7fcedb662640 1 -- 172.21.15.155:0/3359202330 wait complete. 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.541+0000 7fcedb662640 1 Processor -- start 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.541+0000 7fcedb662640 1 -- start start 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fcedb662640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 0x7fced41e1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fcedb662640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced4151ea0 0x7fced4150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fcedb662640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fced40c5890 0x7fced41e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fcedb662640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fced40c8cb0 con 0x7fced40c3cb0 2024-04-25T13:17:35.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fcedb662640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fced406ef90 con 0x7fced40c5890 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fcedb662640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fced415b2d0 con 0x7fced4151ea0 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 0x7fced41e1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 0x7fced41e1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48890/0 (socket says 172.21.15.155:48890) 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 -- 172.21.15.155:0/1585586433 learned_addr learned my addr 172.21.15.155:0/1585586433 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced9bff640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fced40c5890 0x7fced41e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced8bfd640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced4151ea0 0x7fced4150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 -- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced4151ea0 msgr2=0x7fced4150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced4151ea0 0x7fced4150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 -- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fced40c5890 msgr2=0x7fced41e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fced40c5890 0x7fced41e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced93fe640 1 -- 172.21.15.155:0/1585586433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced41f4250 con 0x7fced40c3cb0 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.542+0000 7fced8bfd640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced4151ea0 0x7fced4150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.543+0000 7fced93fe640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 0x7fced41e1b00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fced002c9f0 tx=0x7fced0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.543+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0035040 con 0x7fced40c3cb0 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.543+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced0031e30 con 0x7fced40c3cb0 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.543+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced41f4530 con 0x7fced40c3cb0 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.543+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced003a670 con 0x7fced40c3cb0 2024-04-25T13:17:35.548 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.543+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced41f4af0 con 0x7fced40c3cb0 2024-04-25T13:17:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.544+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced4068e40 con 0x7fced40c3cb0 2024-04-25T13:17:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.545+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fced0038070 con 0x7fced40c3cb0 2024-04-25T13:17:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.545+0000 7fcec9ffb640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fceb806c8f0 0x7fceb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.545+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fced00acf10 con 0x7fced40c3cb0 2024-04-25T13:17:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.545+0000 7fced8bfd640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fceb806c8f0 0x7fceb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.549 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.546+0000 7fced8bfd640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fceb806c8f0 0x7fceb806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fced414be30 tx=0x7fcec4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.549+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fced007afd0 con 0x7fced40c3cb0 2024-04-25T13:17:35.726 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.726+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fced4072100 con 0x7fceb806c8f0 2024-04-25T13:17:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.727+0000 7fcec9ffb640 1 -- 172.21.15.155:0/1585586433 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fced4072100 con 0x7fceb806c8f0 2024-04-25T13:17:35.727 INFO:teuthology.orchestra.run.smithi155.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T13:17:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fceb806c8f0 msgr2=0x7fceb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fceb806c8f0 0x7fceb806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fced414be30 tx=0x7fcec4009040 comp rx=0 tx=0).stop 2024-04-25T13:17:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 msgr2=0x7fced41e1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 0x7fced41e1b00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fced002c9f0 tx=0x7fced0004730 comp rx=0 tx=0).stop 2024-04-25T13:17:35.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 shutdown_connections 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fced40c5890 0x7fced41e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fceb806c8f0 0x7fceb806edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fced4151ea0 0x7fced4150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 --2- 172.21.15.155:0/1585586433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced40c3cb0 0x7fced41e1b00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 >> 172.21.15.155:0/1585586433 conn(0x7fced40c8f00 msgr2=0x7fced40c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 shutdown_connections 2024-04-25T13:17:35.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.729+0000 7fcedb662640 1 -- 172.21.15.155:0/1585586433 wait complete. 2024-04-25T13:17:35.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:35.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.840+0000 7f0a5b2a3640 1 Processor -- start 2024-04-25T13:17:35.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 -- start start 2024-04-25T13:17:35.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f0a54144270 0x7f0a5415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c8e70 0x7f0a54074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a540c9290 0x7f0a54075290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0a5415f4e0 con 0x7f0a540c9290 2024-04-25T13:17:35.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f0a54144650 con 0x7f0a54144270 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a5b2a3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5415b0b0 con 0x7f0a540c8e70 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.841+0000 7f0a59840640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a540c9290 0x7f0a54075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0a540c9290 0x7f0a54075290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48902/0 (socket says 172.21.15.155:48902) 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 -- 172.21.15.155:0/4085795862 learned_addr learned my addr 172.21.15.155:0/4085795862 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a5903f640 1 --2- 172.21.15.155:0/4085795862 >> v2:172.21.15.191:3300/0 conn(0x7f0a54144270 0x7f0a5415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a5883e640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c8e70 0x7f0a54074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 -- 172.21.15.155:0/4085795862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c8e70 msgr2=0x7f0a54074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:35.843 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c8e70 0x7f0a54074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 -- 172.21.15.155:0/4085795862 >> v2:172.21.15.191:3300/0 conn(0x7f0a54144270 msgr2=0x7f0a5415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:35.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 --2- 172.21.15.155:0/4085795862 >> v2:172.21.15.191:3300/0 conn(0x7f0a54144270 0x7f0a5415efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 -- 172.21.15.155:0/4085795862 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a540ce080 con 0x7f0a540c9290 2024-04-25T13:17:35.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a5883e640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c8e70 0x7f0a54074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:35.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.842+0000 7f0a59840640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c9290 0x7f0a54075290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0a5406c900 tx=0x7f0a4402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7f1fad15f60205 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a53fff640 1 -- 172.21.15.155:0/4085795862 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a44037070 con 0x7f0a540c9290 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a53fff640 1 -- 172.21.15.155:0/4085795862 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a44032440 con 0x7f0a540c9290 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a53fff640 1 -- 172.21.15.155:0/4085795862 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a44032810 con 0x7f0a540c9290 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/4085795862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c9290 msgr2=0x7f0a54075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c9290 0x7f0a54075290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0a5406c900 tx=0x7f0a4402a2a0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/4085795862 shutdown_connections 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c9290 0x7f0a54075290 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/4085795862 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c8e70 0x7f0a54074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/4085795862 >> v2:172.21.15.191:3300/0 conn(0x7f0a54144270 0x7f0a5415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/4085795862 >> 172.21.15.155:0/4085795862 conn(0x7f0a5406b920 msgr2=0x7f0a5406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/4085795862 shutdown_connections 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.843+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/4085795862 wait complete. 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.844+0000 7f0a5b2a3640 1 Processor -- start 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.844+0000 7f0a5b2a3640 1 -- start start 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5b2a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 0x7f0a5415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5b2a3640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c9290 0x7f0a5415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5b2a3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a54144270 0x7f0a5415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5b2a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5415b8e0 con 0x7f0a540c8e70 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5b2a3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5415b600 con 0x7f0a54144270 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5b2a3640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f0a540ce360 con 0x7f0a540c9290 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 0x7f0a5415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 0x7f0a5415e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:48916/0 (socket says 172.21.15.155:48916) 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 -- 172.21.15.155:0/3666231818 learned_addr learned my addr 172.21.15.155:0/3666231818 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a59840640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a54144270 0x7f0a5415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5883e640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c9290 0x7f0a5415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 -- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c9290 msgr2=0x7f0a5415c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c9290 0x7f0a5415c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 -- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a54144270 msgr2=0x7f0a5415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a54144270 0x7f0a5415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.845+0000 7f0a5903f640 1 -- 172.21.15.155:0/3666231818 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a541f42b0 con 0x7f0a540c8e70 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.846+0000 7f0a5903f640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 0x7f0a5415e240 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009db0 tx=0x7f0a4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.846+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c018020 con 0x7f0a540c8e70 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.846+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4c014480 con 0x7f0a540c8e70 2024-04-25T13:17:35.851 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.846+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a541f4550 con 0x7f0a540c8e70 2024-04-25T13:17:35.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.846+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c014850 con 0x7f0a540c8e70 2024-04-25T13:17:35.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.846+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a541f4b10 con 0x7f0a540c8e70 2024-04-25T13:17:35.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.847+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a54143130 con 0x7f0a540c8e70 2024-04-25T13:17:35.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.848+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a4c01b020 con 0x7f0a540c8e70 2024-04-25T13:17:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.848+0000 7f0a51ffb640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0a4006c920 0x7f0a4006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.848+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0a4c08ce00 con 0x7f0a540c8e70 2024-04-25T13:17:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.848+0000 7f0a5883e640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0a4006c920 0x7f0a4006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.849+0000 7f0a5883e640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0a4006c920 0x7f0a4006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a48006fd0 tx=0x7f0a48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:35.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:35.853+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a54143130 con 0x7f0a540c8e70 2024-04-25T13:17:36.023 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.023+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a540cda40 con 0x7f0a4006c920 2024-04-25T13:17:36.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.031+0000 7f0a51ffb640 1 -- 172.21.15.155:0/3666231818 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+331040 (secure 0 0 0) 0x7f0a540cda40 con 0x7f0a4006c920 2024-04-25T13:17:36.034 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:36.036 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:17:36.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0a4006c920 msgr2=0x7f0a4006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:36.037 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0a4006c920 0x7f0a4006ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a48006fd0 tx=0x7f0a48008040 comp rx=0 tx=0).stop 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 msgr2=0x7f0a5415e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 0x7f0a5415e240 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009db0 tx=0x7f0a4c00c490 comp rx=0 tx=0).stop 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 shutdown_connections 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0a54144270 0x7f0a5415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f0a4006c920 0x7f0a4006ede0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f0a540c9290 0x7f0a5415c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:36.038 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 --2- 172.21.15.155:0/3666231818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a540c8e70 0x7f0a5415e240 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:36.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 >> 172.21.15.155:0/3666231818 conn(0x7f0a5406b920 msgr2=0x7f0a541433b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:36.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 shutdown_connections 2024-04-25T13:17:36.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:36.034+0000 7f0a5b2a3640 1 -- 172.21.15.155:0/3666231818 wait complete. 2024-04-25T13:17:36.045 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-25T13:17:35.633268+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":311,"ondisk_log_size":311,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219816,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754904,"statfs":{"total":773094113280,"available":772869021696,"internally_reserved":0,"allocated":3776512,"data_stored":2158240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002451"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835866+0000","last_change":"2024-04-25T13:16:20.660461+0000","last_active":"2024-04-25T13:17:10.835866+0000","last_peered":"2024-04-25T13:17:10.835866+0000","last_clean":"2024-04-25T13:17:10.835866+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:17:10.835866+0000","last_undegraded":"2024-04-25T13:17:10.835866+0000","last_fullsized":"2024-04-25T13:17:10.835866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.645087+0000","last_change":"2024-04-25T13:17:03.509734+0000","last_active":"2024-04-25T13:17:03.645087+0000","last_peered":"2024-04-25T13:17:03.645087+0000","last_clean":"2024-04-25T13:17:03.645087+0000","last_became_active":"2024-04-25T13:17:03.509296+0000","last_became_peered":"2024-04-25T13:17:03.509296+0000","last_unstale":"2024-04-25T13:17:03.645087+0000","last_undegraded":"2024-04-25T13:17:03.645087+0000","last_fullsized":"2024-04-25T13:17:03.645087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811834+0000","last_change":"2024-04-25T13:16:25.710017+0000","last_active":"2024-04-25T13:17:02.811834+0000","last_peered":"2024-04-25T13:17:02.811834+0000","last_clean":"2024-04-25T13:17:02.811834+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:17:02.811834+0000","last_undegraded":"2024-04-25T13:17:02.811834+0000","last_fullsized":"2024-04-25T13:17:02.811834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:26:49.465020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812634+0000","last_change":"2024-04-25T13:16:20.662324+0000","last_active":"2024-04-25T13:17:02.812634+0000","last_peered":"2024-04-25T13:17:02.812634+0000","last_clean":"2024-04-25T13:17:02.812634+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:17:02.812634+0000","last_undegraded":"2024-04-25T13:17:02.812634+0000","last_fullsized":"2024-04-25T13:17:02.812634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:38.312275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815106+0000","last_change":"2024-04-25T13:16:21.680401+0000","last_active":"2024-04-25T13:17:02.815106+0000","last_peered":"2024-04-25T13:17:02.815106+0000","last_clean":"2024-04-25T13:17:02.815106+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:17:02.815106+0000","last_undegraded":"2024-04-25T13:17:02.815106+0000","last_fullsized":"2024-04-25T13:17:02.815106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507295+0000","last_change":"2024-04-25T13:16:25.711973+0000","last_active":"2024-04-25T13:17:03.507295+0000","last_peered":"2024-04-25T13:17:03.507295+0000","last_clean":"2024-04-25T13:17:03.507295+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:17:03.507295+0000","last_undegraded":"2024-04-25T13:17:03.507295+0000","last_fullsized":"2024-04-25T13:17:03.507295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:56.417003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836728+0000","last_change":"2024-04-25T13:16:20.663521+0000","last_active":"2024-04-25T13:17:10.836728+0000","last_peered":"2024-04-25T13:17:10.836728+0000","last_clean":"2024-04-25T13:17:10.836728+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:17:10.836728+0000","last_undegraded":"2024-04-25T13:17:10.836728+0000","last_fullsized":"2024-04-25T13:17:10.836728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:19.361861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814019+0000","last_change":"2024-04-25T13:16:21.675762+0000","last_active":"2024-04-25T13:17:02.814019+0000","last_peered":"2024-04-25T13:17:02.814019+0000","last_clean":"2024-04-25T13:17:02.814019+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:17:02.814019+0000","last_undegraded":"2024-04-25T13:17:02.814019+0000","last_fullsized":"2024-04-25T13:17:02.814019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:45.933117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507708+0000","last_change":"2024-04-25T13:16:25.703061+0000","last_active":"2024-04-25T13:17:03.507708+0000","last_peered":"2024-04-25T13:17:03.507708+0000","last_clean":"2024-04-25T13:17:03.507708+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:17:03.507708+0000","last_undegraded":"2024-04-25T13:17:03.507708+0000","last_fullsized":"2024-04-25T13:17:03.507708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:06.398946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836368+0000","last_change":"2024-04-25T13:16:20.665235+0000","last_active":"2024-04-25T13:17:10.836368+0000","last_peered":"2024-04-25T13:17:10.836368+0000","last_clean":"2024-04-25T13:17:10.836368+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:17:10.836368+0000","last_undegraded":"2024-04-25T13:17:10.836368+0000","last_fullsized":"2024-04-25T13:17:10.836368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:41.246472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814079+0000","last_change":"2024-04-25T13:16:21.674859+0000","last_active":"2024-04-25T13:17:02.814079+0000","last_peered":"2024-04-25T13:17:02.814079+0000","last_clean":"2024-04-25T13:17:02.814079+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:17:02.814079+0000","last_undegraded":"2024-04-25T13:17:02.814079+0000","last_fullsized":"2024-04-25T13:17:02.814079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:01.106889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507393+0000","last_change":"2024-04-25T13:16:25.707439+0000","last_active":"2024-04-25T13:17:03.507393+0000","last_peered":"2024-04-25T13:17:03.507393+0000","last_clean":"2024-04-25T13:17:03.507393+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:17:03.507393+0000","last_undegraded":"2024-04-25T13:17:03.507393+0000","last_fullsized":"2024-04-25T13:17:03.507393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:40.879100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507939+0000","last_change":"2024-04-25T13:16:21.681131+0000","last_active":"2024-04-25T13:17:03.507939+0000","last_peered":"2024-04-25T13:17:03.507939+0000","last_clean":"2024-04-25T13:17:03.507939+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:17:03.507939+0000","last_undegraded":"2024-04-25T13:17:03.507939+0000","last_fullsized":"2024-04-25T13:17:03.507939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:16.695939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811751+0000","last_change":"2024-04-25T13:16:20.656321+0000","last_active":"2024-04-25T13:17:02.811751+0000","last_peered":"2024-04-25T13:17:02.811751+0000","last_clean":"2024-04-25T13:17:02.811751+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:17:02.811751+0000","last_undegraded":"2024-04-25T13:17:02.811751+0000","last_fullsized":"2024-04-25T13:17:02.811751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:54.467341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507691+0000","last_change":"2024-04-25T13:16:25.699763+0000","last_active":"2024-04-25T13:17:03.507691+0000","last_peered":"2024-04-25T13:17:03.507691+0000","last_clean":"2024-04-25T13:17:03.507691+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:17:03.507691+0000","last_undegraded":"2024-04-25T13:17:03.507691+0000","last_fullsized":"2024-04-25T13:17:03.507691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:55.642153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812072+0000","last_change":"2024-04-25T13:16:21.671822+0000","last_active":"2024-04-25T13:17:02.812072+0000","last_peered":"2024-04-25T13:17:02.812072+0000","last_clean":"2024-04-25T13:17:02.812072+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:17:02.812072+0000","last_undegraded":"2024-04-25T13:17:02.812072+0000","last_fullsized":"2024-04-25T13:17:02.812072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:01.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.823133+0000","last_change":"2024-04-25T13:16:20.656572+0000","last_active":"2024-04-25T13:17:10.823133+0000","last_peered":"2024-04-25T13:17:10.823133+0000","last_clean":"2024-04-25T13:17:10.823133+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:17:10.823133+0000","last_undegraded":"2024-04-25T13:17:10.823133+0000","last_fullsized":"2024-04-25T13:17:10.823133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507510+0000","last_change":"2024-04-25T13:16:25.718115+0000","last_active":"2024-04-25T13:17:03.507510+0000","last_peered":"2024-04-25T13:17:03.507510+0000","last_clean":"2024-04-25T13:17:03.507510+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:17:03.507510+0000","last_undegraded":"2024-04-25T13:17:03.507510+0000","last_fullsized":"2024-04-25T13:17:03.507510+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:26.840998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811882+0000","last_change":"2024-04-25T13:16:21.667290+0000","last_active":"2024-04-25T13:17:02.811882+0000","last_peered":"2024-04-25T13:17:02.811882+0000","last_clean":"2024-04-25T13:17:02.811882+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:17:02.811882+0000","last_undegraded":"2024-04-25T13:17:02.811882+0000","last_fullsized":"2024-04-25T13:17:02.811882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:59.375161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832453+0000","last_change":"2024-04-25T13:16:20.657708+0000","last_active":"2024-04-25T13:17:10.832453+0000","last_peered":"2024-04-25T13:17:10.832453+0000","last_clean":"2024-04-25T13:17:10.832453+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:17:10.832453+0000","last_undegraded":"2024-04-25T13:17:10.832453+0000","last_fullsized":"2024-04-25T13:17:10.832453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814971+0000","last_change":"2024-04-25T13:16:25.713800+0000","last_active":"2024-04-25T13:17:02.814971+0000","last_peered":"2024-04-25T13:17:02.814971+0000","last_clean":"2024-04-25T13:17:02.814971+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:17:02.814971+0000","last_undegraded":"2024-04-25T13:17:02.814971+0000","last_fullsized":"2024-04-25T13:17:02.814971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508089+0000","last_change":"2024-04-25T13:16:21.669483+0000","last_active":"2024-04-25T13:17:03.508089+0000","last_peered":"2024-04-25T13:17:03.508089+0000","last_clean":"2024-04-25T13:17:03.508089+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:17:03.508089+0000","last_undegraded":"2024-04-25T13:17:03.508089+0000","last_fullsized":"2024-04-25T13:17:03.508089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:16.729807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811200+0000","last_change":"2024-04-25T13:16:20.663319+0000","last_active":"2024-04-25T13:17:02.811200+0000","last_peered":"2024-04-25T13:17:02.811200+0000","last_clean":"2024-04-25T13:17:02.811200+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:17:02.811200+0000","last_undegraded":"2024-04-25T13:17:02.811200+0000","last_fullsized":"2024-04-25T13:17:02.811200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:01.488392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507642+0000","last_change":"2024-04-25T13:16:25.707832+0000","last_active":"2024-04-25T13:17:03.507642+0000","last_peered":"2024-04-25T13:17:03.507642+0000","last_clean":"2024-04-25T13:17:03.507642+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:17:03.507642+0000","last_undegraded":"2024-04-25T13:17:03.507642+0000","last_fullsized":"2024-04-25T13:17:03.507642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:09.851335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815423+0000","last_change":"2024-04-25T13:16:21.672339+0000","last_active":"2024-04-25T13:17:02.815423+0000","last_peered":"2024-04-25T13:17:02.815423+0000","last_clean":"2024-04-25T13:17:02.815423+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:17:02.815423+0000","last_undegraded":"2024-04-25T13:17:02.815423+0000","last_fullsized":"2024-04-25T13:17:02.815423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832870+0000","last_change":"2024-04-25T13:16:20.668543+0000","last_active":"2024-04-25T13:17:10.832870+0000","last_peered":"2024-04-25T13:17:10.832870+0000","last_clean":"2024-04-25T13:17:10.832870+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:17:10.832870+0000","last_undegraded":"2024-04-25T13:17:10.832870+0000","last_fullsized":"2024-04-25T13:17:10.832870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:12:36.658649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507891+0000","last_change":"2024-04-25T13:16:25.701503+0000","last_active":"2024-04-25T13:17:03.507891+0000","last_peered":"2024-04-25T13:17:03.507891+0000","last_clean":"2024-04-25T13:17:03.507891+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:17:03.507891+0000","last_undegraded":"2024-04-25T13:17:03.507891+0000","last_fullsized":"2024-04-25T13:17:03.507891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:37:43.944564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813293+0000","last_change":"2024-04-25T13:16:21.666880+0000","last_active":"2024-04-25T13:17:02.813293+0000","last_peered":"2024-04-25T13:17:02.813293+0000","last_clean":"2024-04-25T13:17:02.813293+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:17:02.813293+0000","last_undegraded":"2024-04-25T13:17:02.813293+0000","last_fullsized":"2024-04-25T13:17:02.813293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:32.434025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814854+0000","last_change":"2024-04-25T13:16:20.663841+0000","last_active":"2024-04-25T13:17:04.814854+0000","last_peered":"2024-04-25T13:17:04.814854+0000","last_clean":"2024-04-25T13:17:04.814854+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:17:04.814854+0000","last_undegraded":"2024-04-25T13:17:04.814854+0000","last_fullsized":"2024-04-25T13:17:04.814854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811569+0000","last_change":"2024-04-25T13:16:25.709897+0000","last_active":"2024-04-25T13:17:02.811569+0000","last_peered":"2024-04-25T13:17:02.811569+0000","last_clean":"2024-04-25T13:17:02.811569+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:17:02.811569+0000","last_undegraded":"2024-04-25T13:17:02.811569+0000","last_fullsized":"2024-04-25T13:17:02.811569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:32.250268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814440+0000","last_change":"2024-04-25T13:16:21.663093+0000","last_active":"2024-04-25T13:17:02.814440+0000","last_peered":"2024-04-25T13:17:02.814440+0000","last_clean":"2024-04-25T13:17:02.814440+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:17:02.814440+0000","last_undegraded":"2024-04-25T13:17:02.814440+0000","last_fullsized":"2024-04-25T13:17:02.814440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813543+0000","last_change":"2024-04-25T13:16:20.662440+0000","last_active":"2024-04-25T13:17:04.813543+0000","last_peered":"2024-04-25T13:17:04.813543+0000","last_clean":"2024-04-25T13:17:04.813543+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:17:04.813543+0000","last_undegraded":"2024-04-25T13:17:04.813543+0000","last_fullsized":"2024-04-25T13:17:04.813543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:46.251980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.823972+0000","last_change":"2024-04-25T13:17:02.819618+0000","last_active":"2024-04-25T13:17:02.823972+0000","last_peered":"2024-04-25T13:17:02.823972+0000","last_clean":"2024-04-25T13:17:02.823972+0000","last_became_active":"2024-04-25T13:17:02.819016+0000","last_became_peered":"2024-04-25T13:17:02.819016+0000","last_unstale":"2024-04-25T13:17:02.823972+0000","last_undegraded":"2024-04-25T13:17:02.823972+0000","last_fullsized":"2024-04-25T13:17:02.823972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814175+0000","last_change":"2024-04-25T13:16:21.672493+0000","last_active":"2024-04-25T13:17:02.814175+0000","last_peered":"2024-04-25T13:17:02.814175+0000","last_clean":"2024-04-25T13:17:02.814175+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:17:02.814175+0000","last_undegraded":"2024-04-25T13:17:02.814175+0000","last_fullsized":"2024-04-25T13:17:02.814175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:08:35.178573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813504+0000","last_change":"2024-04-25T13:16:20.658369+0000","last_active":"2024-04-25T13:17:04.813504+0000","last_peered":"2024-04-25T13:17:04.813504+0000","last_clean":"2024-04-25T13:17:04.813504+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:17:04.813504+0000","last_undegraded":"2024-04-25T13:17:04.813504+0000","last_fullsized":"2024-04-25T13:17:04.813504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813845+0000","last_change":"2024-04-25T13:16:25.710021+0000","last_active":"2024-04-25T13:17:02.813845+0000","last_peered":"2024-04-25T13:17:02.813845+0000","last_clean":"2024-04-25T13:17:02.813845+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:17:02.813845+0000","last_undegraded":"2024-04-25T13:17:02.813845+0000","last_fullsized":"2024-04-25T13:17:02.813845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507846+0000","last_change":"2024-04-25T13:16:21.675409+0000","last_active":"2024-04-25T13:17:03.507846+0000","last_peered":"2024-04-25T13:17:03.507846+0000","last_clean":"2024-04-25T13:17:03.507846+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:17:03.507846+0000","last_undegraded":"2024-04-25T13:17:03.507846+0000","last_fullsized":"2024-04-25T13:17:03.507846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:36.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836505+0000","last_change":"2024-04-25T13:16:20.662292+0000","last_active":"2024-04-25T13:17:10.836505+0000","last_peered":"2024-04-25T13:17:10.836505+0000","last_clean":"2024-04-25T13:17:10.836505+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:17:10.836505+0000","last_undegraded":"2024-04-25T13:17:10.836505+0000","last_fullsized":"2024-04-25T13:17:10.836505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:47.437859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.510055+0000","last_change":"2024-04-25T13:17:03.509676+0000","last_active":"2024-04-25T13:17:03.510055+0000","last_peered":"2024-04-25T13:17:03.510055+0000","last_clean":"2024-04-25T13:17:03.510055+0000","last_became_active":"2024-04-25T13:17:03.509216+0000","last_became_peered":"2024-04-25T13:17:03.509216+0000","last_unstale":"2024-04-25T13:17:03.510055+0000","last_undegraded":"2024-04-25T13:17:03.510055+0000","last_fullsized":"2024-04-25T13:17:03.510055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:03.726370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814558+0000","last_change":"2024-04-25T13:16:21.660792+0000","last_active":"2024-04-25T13:17:02.814558+0000","last_peered":"2024-04-25T13:17:02.814558+0000","last_clean":"2024-04-25T13:17:02.814558+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:17:02.814558+0000","last_undegraded":"2024-04-25T13:17:02.814558+0000","last_fullsized":"2024-04-25T13:17:02.814558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.120840+0000","last_change":"2024-04-25T13:16:20.659600+0000","last_active":"2024-04-25T13:17:19.120840+0000","last_peered":"2024-04-25T13:17:19.120840+0000","last_clean":"2024-04-25T13:17:19.120840+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:17:19.120840+0000","last_undegraded":"2024-04-25T13:17:19.120840+0000","last_fullsized":"2024-04-25T13:17:19.120840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815086+0000","last_change":"2024-04-25T13:16:25.713346+0000","last_active":"2024-04-25T13:17:02.815086+0000","last_peered":"2024-04-25T13:17:02.815086+0000","last_clean":"2024-04-25T13:17:02.815086+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:17:02.815086+0000","last_undegraded":"2024-04-25T13:17:02.815086+0000","last_fullsized":"2024-04-25T13:17:02.815086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815734+0000","last_change":"2024-04-25T13:16:21.676319+0000","last_active":"2024-04-25T13:17:02.815734+0000","last_peered":"2024-04-25T13:17:02.815734+0000","last_clean":"2024-04-25T13:17:02.815734+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:17:02.815734+0000","last_undegraded":"2024-04-25T13:17:02.815734+0000","last_fullsized":"2024-04-25T13:17:02.815734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811263+0000","last_change":"2024-04-25T13:16:20.663569+0000","last_active":"2024-04-25T13:17:02.811263+0000","last_peered":"2024-04-25T13:17:02.811263+0000","last_clean":"2024-04-25T13:17:02.811263+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:17:02.811263+0000","last_undegraded":"2024-04-25T13:17:02.811263+0000","last_fullsized":"2024-04-25T13:17:02.811263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.820600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815214+0000","last_change":"2024-04-25T13:16:25.706089+0000","last_active":"2024-04-25T13:17:02.815214+0000","last_peered":"2024-04-25T13:17:02.815214+0000","last_clean":"2024-04-25T13:17:02.815214+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:17:02.815214+0000","last_undegraded":"2024-04-25T13:17:02.815214+0000","last_fullsized":"2024-04-25T13:17:02.815214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812304+0000","last_change":"2024-04-25T13:16:21.676657+0000","last_active":"2024-04-25T13:17:02.812304+0000","last_peered":"2024-04-25T13:17:02.812304+0000","last_clean":"2024-04-25T13:17:02.812304+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:17:02.812304+0000","last_undegraded":"2024-04-25T13:17:02.812304+0000","last_fullsized":"2024-04-25T13:17:02.812304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:37.701777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813257+0000","last_change":"2024-04-25T13:16:20.663871+0000","last_active":"2024-04-25T13:17:04.813257+0000","last_peered":"2024-04-25T13:17:04.813257+0000","last_clean":"2024-04-25T13:17:04.813257+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:17:04.813257+0000","last_undegraded":"2024-04-25T13:17:04.813257+0000","last_fullsized":"2024-04-25T13:17:04.813257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:00:43.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811317+0000","last_change":"2024-04-25T13:16:11.681940+0000","last_active":"2024-04-25T13:17:02.811317+0000","last_peered":"2024-04-25T13:17:02.811317+0000","last_clean":"2024-04-25T13:17:02.811317+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:17:02.811317+0000","last_undegraded":"2024-04-25T13:17:02.811317+0000","last_fullsized":"2024-04-25T13:17:02.811317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:10.615139+0000","last_clean_scrub_stamp":"2024-04-25T13:16:10.615139+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:42.650310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508569+0000","last_change":"2024-04-25T13:16:25.717859+0000","last_active":"2024-04-25T13:17:03.508569+0000","last_peered":"2024-04-25T13:17:03.508569+0000","last_clean":"2024-04-25T13:17:03.508569+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:17:03.508569+0000","last_undegraded":"2024-04-25T13:17:03.508569+0000","last_fullsized":"2024-04-25T13:17:03.508569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:16.184104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811924+0000","last_change":"2024-04-25T13:16:21.667449+0000","last_active":"2024-04-25T13:17:02.811924+0000","last_peered":"2024-04-25T13:17:02.811924+0000","last_clean":"2024-04-25T13:17:02.811924+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:17:02.811924+0000","last_undegraded":"2024-04-25T13:17:02.811924+0000","last_fullsized":"2024-04-25T13:17:02.811924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:40.267514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:23.553530+0000","last_change":"2024-04-25T13:16:20.664715+0000","last_active":"2024-04-25T13:17:23.553530+0000","last_peered":"2024-04-25T13:17:23.553530+0000","last_clean":"2024-04-25T13:17:23.553530+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:17:23.553530+0000","last_undegraded":"2024-04-25T13:17:23.553530+0000","last_fullsized":"2024-04-25T13:17:23.553530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507938+0000","last_change":"2024-04-25T13:16:25.705917+0000","last_active":"2024-04-25T13:17:03.507938+0000","last_peered":"2024-04-25T13:17:03.507938+0000","last_clean":"2024-04-25T13:17:03.507938+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:17:03.507938+0000","last_undegraded":"2024-04-25T13:17:03.507938+0000","last_fullsized":"2024-04-25T13:17:03.507938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:52.175410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814058+0000","last_change":"2024-04-25T13:16:21.668024+0000","last_active":"2024-04-25T13:17:02.814058+0000","last_peered":"2024-04-25T13:17:02.814058+0000","last_clean":"2024-04-25T13:17:02.814058+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:17:02.814058+0000","last_undegraded":"2024-04-25T13:17:02.814058+0000","last_fullsized":"2024-04-25T13:17:02.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:48.096772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.833003+0000","last_change":"2024-04-25T13:16:20.657998+0000","last_active":"2024-04-25T13:17:10.833003+0000","last_peered":"2024-04-25T13:17:10.833003+0000","last_clean":"2024-04-25T13:17:10.833003+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:17:10.833003+0000","last_undegraded":"2024-04-25T13:17:10.833003+0000","last_fullsized":"2024-04-25T13:17:10.833003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816233+0000","last_change":"2024-04-25T13:16:25.702002+0000","last_active":"2024-04-25T13:17:02.816233+0000","last_peered":"2024-04-25T13:17:02.816233+0000","last_clean":"2024-04-25T13:17:02.816233+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:17:02.816233+0000","last_undegraded":"2024-04-25T13:17:02.816233+0000","last_fullsized":"2024-04-25T13:17:02.816233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812288+0000","last_change":"2024-04-25T13:16:21.678723+0000","last_active":"2024-04-25T13:17:02.812288+0000","last_peered":"2024-04-25T13:17:02.812288+0000","last_clean":"2024-04-25T13:17:02.812288+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:17:02.812288+0000","last_undegraded":"2024-04-25T13:17:02.812288+0000","last_fullsized":"2024-04-25T13:17:02.812288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:33.098209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.835549+0000","last_change":"2024-04-25T13:16:20.659444+0000","last_active":"2024-04-25T13:17:10.835549+0000","last_peered":"2024-04-25T13:17:10.835549+0000","last_clean":"2024-04-25T13:17:10.835549+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:17:10.835549+0000","last_undegraded":"2024-04-25T13:17:10.835549+0000","last_fullsized":"2024-04-25T13:17:10.835549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813046+0000","last_change":"2024-04-25T13:16:25.704360+0000","last_active":"2024-04-25T13:17:02.813046+0000","last_peered":"2024-04-25T13:17:02.813046+0000","last_clean":"2024-04-25T13:17:02.813046+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:17:02.813046+0000","last_undegraded":"2024-04-25T13:17:02.813046+0000","last_fullsized":"2024-04-25T13:17:02.813046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:23.849574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811950+0000","last_change":"2024-04-25T13:16:21.677925+0000","last_active":"2024-04-25T13:17:02.811950+0000","last_peered":"2024-04-25T13:17:02.811950+0000","last_clean":"2024-04-25T13:17:02.811950+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:17:02.811950+0000","last_undegraded":"2024-04-25T13:17:02.811950+0000","last_fullsized":"2024-04-25T13:17:02.811950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:39.563209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507795+0000","last_change":"2024-04-25T13:16:20.662284+0000","last_active":"2024-04-25T13:17:03.507795+0000","last_peered":"2024-04-25T13:17:03.507795+0000","last_clean":"2024-04-25T13:17:03.507795+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:17:03.507795+0000","last_undegraded":"2024-04-25T13:17:03.507795+0000","last_fullsized":"2024-04-25T13:17:03.507795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:18.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507210+0000","last_change":"2024-04-25T13:16:25.712034+0000","last_active":"2024-04-25T13:17:03.507210+0000","last_peered":"2024-04-25T13:17:03.507210+0000","last_clean":"2024-04-25T13:17:03.507210+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:17:03.507210+0000","last_undegraded":"2024-04-25T13:17:03.507210+0000","last_fullsized":"2024-04-25T13:17:03.507210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:27:26.597267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811434+0000","last_change":"2024-04-25T13:16:21.679368+0000","last_active":"2024-04-25T13:17:02.811434+0000","last_peered":"2024-04-25T13:17:02.811434+0000","last_clean":"2024-04-25T13:17:02.811434+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:17:02.811434+0000","last_undegraded":"2024-04-25T13:17:02.811434+0000","last_fullsized":"2024-04-25T13:17:02.811434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:16.218857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.832609+0000","last_change":"2024-04-25T13:16:20.662201+0000","last_active":"2024-04-25T13:17:10.832609+0000","last_peered":"2024-04-25T13:17:10.832609+0000","last_clean":"2024-04-25T13:17:10.832609+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:17:10.832609+0000","last_undegraded":"2024-04-25T13:17:10.832609+0000","last_fullsized":"2024-04-25T13:17:10.832609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814690+0000","last_change":"2024-04-25T13:16:25.711901+0000","last_active":"2024-04-25T13:17:02.814690+0000","last_peered":"2024-04-25T13:17:02.814690+0000","last_clean":"2024-04-25T13:17:02.814690+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:17:02.814690+0000","last_undegraded":"2024-04-25T13:17:02.814690+0000","last_fullsized":"2024-04-25T13:17:02.814690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508154+0000","last_change":"2024-04-25T13:16:21.675696+0000","last_active":"2024-04-25T13:17:03.508154+0000","last_peered":"2024-04-25T13:17:03.508154+0000","last_clean":"2024-04-25T13:17:03.508154+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:17:03.508154+0000","last_undegraded":"2024-04-25T13:17:03.508154+0000","last_fullsized":"2024-04-25T13:17:03.508154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:08.586203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.121264+0000","last_change":"2024-04-25T13:16:20.667246+0000","last_active":"2024-04-25T13:17:19.121264+0000","last_peered":"2024-04-25T13:17:19.121264+0000","last_clean":"2024-04-25T13:17:19.121264+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:17:19.121264+0000","last_undegraded":"2024-04-25T13:17:19.121264+0000","last_fullsized":"2024-04-25T13:17:19.121264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:48:47.382811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812765+0000","last_change":"2024-04-25T13:16:25.715641+0000","last_active":"2024-04-25T13:17:02.812765+0000","last_peered":"2024-04-25T13:17:02.812765+0000","last_clean":"2024-04-25T13:17:02.812765+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:17:02.812765+0000","last_undegraded":"2024-04-25T13:17:02.812765+0000","last_fullsized":"2024-04-25T13:17:02.812765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:24.718244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811663+0000","last_change":"2024-04-25T13:16:21.678040+0000","last_active":"2024-04-25T13:17:02.811663+0000","last_peered":"2024-04-25T13:17:02.811663+0000","last_clean":"2024-04-25T13:17:02.811663+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:17:02.811663+0000","last_undegraded":"2024-04-25T13:17:02.811663+0000","last_fullsized":"2024-04-25T13:17:02.811663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:21.424289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813445+0000","last_change":"2024-04-25T13:16:20.666466+0000","last_active":"2024-04-25T13:17:04.813445+0000","last_peered":"2024-04-25T13:17:04.813445+0000","last_clean":"2024-04-25T13:17:04.813445+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:17:04.813445+0000","last_undegraded":"2024-04-25T13:17:04.813445+0000","last_fullsized":"2024-04-25T13:17:04.813445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:44.896733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.818420+0000","last_change":"2024-04-25T13:17:02.818420+0000","last_active":"2024-04-25T13:17:02.818420+0000","last_peered":"2024-04-25T13:17:02.818420+0000","last_clean":"2024-04-25T13:17:02.818420+0000","last_became_active":"2024-04-25T13:17:02.817864+0000","last_became_peered":"2024-04-25T13:17:02.817864+0000","last_unstale":"2024-04-25T13:17:02.818420+0000","last_undegraded":"2024-04-25T13:17:02.818420+0000","last_fullsized":"2024-04-25T13:17:02.818420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:52.960881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816040+0000","last_change":"2024-04-25T13:16:21.669804+0000","last_active":"2024-04-25T13:17:02.816040+0000","last_peered":"2024-04-25T13:17:02.816040+0000","last_clean":"2024-04-25T13:17:02.816040+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:17:02.816040+0000","last_undegraded":"2024-04-25T13:17:02.816040+0000","last_fullsized":"2024-04-25T13:17:02.816040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836161+0000","last_change":"2024-04-25T13:16:20.663069+0000","last_active":"2024-04-25T13:17:10.836161+0000","last_peered":"2024-04-25T13:17:10.836161+0000","last_clean":"2024-04-25T13:17:10.836161+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:17:10.836161+0000","last_undegraded":"2024-04-25T13:17:10.836161+0000","last_fullsized":"2024-04-25T13:17:10.836161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813967+0000","last_change":"2024-04-25T13:16:25.708543+0000","last_active":"2024-04-25T13:17:02.813967+0000","last_peered":"2024-04-25T13:17:02.813967+0000","last_clean":"2024-04-25T13:17:02.813967+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:17:02.813967+0000","last_undegraded":"2024-04-25T13:17:02.813967+0000","last_fullsized":"2024-04-25T13:17:02.813967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:49.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811857+0000","last_change":"2024-04-25T13:16:21.671386+0000","last_active":"2024-04-25T13:17:02.811857+0000","last_peered":"2024-04-25T13:17:02.811857+0000","last_clean":"2024-04-25T13:17:02.811857+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:17:02.811857+0000","last_undegraded":"2024-04-25T13:17:02.811857+0000","last_fullsized":"2024-04-25T13:17:02.811857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:15.141038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'16","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.123871+0000","last_change":"2024-04-25T13:16:20.666121+0000","last_active":"2024-04-25T13:17:19.123871+0000","last_peered":"2024-04-25T13:17:19.123871+0000","last_clean":"2024-04-25T13:17:19.123871+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:17:19.123871+0000","last_undegraded":"2024-04-25T13:17:19.123871+0000","last_fullsized":"2024-04-25T13:17:19.123871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:19.085499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813877+0000","last_change":"2024-04-25T13:16:25.708282+0000","last_active":"2024-04-25T13:17:02.813877+0000","last_peered":"2024-04-25T13:17:02.813877+0000","last_clean":"2024-04-25T13:17:02.813877+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:17:02.813877+0000","last_undegraded":"2024-04-25T13:17:02.813877+0000","last_fullsized":"2024-04-25T13:17:02.813877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507633+0000","last_change":"2024-04-25T13:16:21.673167+0000","last_active":"2024-04-25T13:17:03.507633+0000","last_peered":"2024-04-25T13:17:03.507633+0000","last_clean":"2024-04-25T13:17:03.507633+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:17:03.507633+0000","last_undegraded":"2024-04-25T13:17:03.507633+0000","last_fullsized":"2024-04-25T13:17:03.507633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:14.478964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.813993+0000","last_change":"2024-04-25T13:16:20.663850+0000","last_active":"2024-04-25T13:17:04.813993+0000","last_peered":"2024-04-25T13:17:04.813993+0000","last_clean":"2024-04-25T13:17:04.813993+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:17:04.813993+0000","last_undegraded":"2024-04-25T13:17:04.813993+0000","last_fullsized":"2024-04-25T13:17:04.813993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507401+0000","last_change":"2024-04-25T13:16:25.703514+0000","last_active":"2024-04-25T13:17:03.507401+0000","last_peered":"2024-04-25T13:17:03.507401+0000","last_clean":"2024-04-25T13:17:03.507401+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:17:03.507401+0000","last_undegraded":"2024-04-25T13:17:03.507401+0000","last_fullsized":"2024-04-25T13:17:03.507401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:29.384620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814827+0000","last_change":"2024-04-25T13:16:21.680975+0000","last_active":"2024-04-25T13:17:02.814827+0000","last_peered":"2024-04-25T13:17:02.814827+0000","last_clean":"2024-04-25T13:17:02.814827+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:17:02.814827+0000","last_undegraded":"2024-04-25T13:17:02.814827+0000","last_fullsized":"2024-04-25T13:17:02.814827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:10.836480+0000","last_change":"2024-04-25T13:16:20.668491+0000","last_active":"2024-04-25T13:17:10.836480+0000","last_peered":"2024-04-25T13:17:10.836480+0000","last_clean":"2024-04-25T13:17:10.836480+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:17:10.836480+0000","last_undegraded":"2024-04-25T13:17:10.836480+0000","last_fullsized":"2024-04-25T13:17:10.836480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:00.604151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811722+0000","last_change":"2024-04-25T13:16:25.709385+0000","last_active":"2024-04-25T13:17:02.811722+0000","last_peered":"2024-04-25T13:17:02.811722+0000","last_clean":"2024-04-25T13:17:02.811722+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:17:02.811722+0000","last_undegraded":"2024-04-25T13:17:02.811722+0000","last_fullsized":"2024-04-25T13:17:02.811722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:45.812918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.640017+0000","last_change":"2024-04-25T13:17:02.817603+0000","last_active":"2024-04-25T13:17:03.640017+0000","last_peered":"2024-04-25T13:17:03.640017+0000","last_clean":"2024-04-25T13:17:03.640017+0000","last_became_active":"2024-04-25T13:17:02.817270+0000","last_became_peered":"2024-04-25T13:17:02.817270+0000","last_unstale":"2024-04-25T13:17:03.640017+0000","last_undegraded":"2024-04-25T13:17:03.640017+0000","last_fullsized":"2024-04-25T13:17:03.640017+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118727+0000","last_change":"2024-04-25T13:16:20.664817+0000","last_active":"2024-04-25T13:17:19.118727+0000","last_peered":"2024-04-25T13:17:19.118727+0000","last_clean":"2024-04-25T13:17:19.118727+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:17:19.118727+0000","last_undegraded":"2024-04-25T13:17:19.118727+0000","last_fullsized":"2024-04-25T13:17:19.118727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:57.667284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811958+0000","last_change":"2024-04-25T13:16:25.715893+0000","last_active":"2024-04-25T13:17:02.811958+0000","last_peered":"2024-04-25T13:17:02.811958+0000","last_clean":"2024-04-25T13:17:02.811958+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:17:02.811958+0000","last_undegraded":"2024-04-25T13:17:02.811958+0000","last_fullsized":"2024-04-25T13:17:02.811958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:23.112428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814462+0000","last_change":"2024-04-25T13:16:25.711192+0000","last_active":"2024-04-25T13:17:02.814462+0000","last_peered":"2024-04-25T13:17:02.814462+0000","last_clean":"2024-04-25T13:17:02.814462+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:17:02.814462+0000","last_undegraded":"2024-04-25T13:17:02.814462+0000","last_fullsized":"2024-04-25T13:17:02.814462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813659+0000","last_change":"2024-04-25T13:16:21.668419+0000","last_active":"2024-04-25T13:17:02.813659+0000","last_peered":"2024-04-25T13:17:02.813659+0000","last_clean":"2024-04-25T13:17:02.813659+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:17:02.813659+0000","last_undegraded":"2024-04-25T13:17:02.813659+0000","last_fullsized":"2024-04-25T13:17:02.813659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814202+0000","last_change":"2024-04-25T13:16:20.663763+0000","last_active":"2024-04-25T13:17:04.814202+0000","last_peered":"2024-04-25T13:17:04.814202+0000","last_clean":"2024-04-25T13:17:04.814202+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:17:04.814202+0000","last_undegraded":"2024-04-25T13:17:04.814202+0000","last_fullsized":"2024-04-25T13:17:04.814202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:12.589479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508256+0000","last_change":"2024-04-25T13:16:25.703942+0000","last_active":"2024-04-25T13:17:03.508256+0000","last_peered":"2024-04-25T13:17:03.508256+0000","last_clean":"2024-04-25T13:17:03.508256+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:17:03.508256+0000","last_undegraded":"2024-04-25T13:17:03.508256+0000","last_fullsized":"2024-04-25T13:17:03.508256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:21.920918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811828+0000","last_change":"2024-04-25T13:16:21.667875+0000","last_active":"2024-04-25T13:17:02.811828+0000","last_peered":"2024-04-25T13:17:02.811828+0000","last_clean":"2024-04-25T13:17:02.811828+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:17:02.811828+0000","last_undegraded":"2024-04-25T13:17:02.811828+0000","last_fullsized":"2024-04-25T13:17:02.811828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:09.377284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.814084+0000","last_change":"2024-04-25T13:16:20.663109+0000","last_active":"2024-04-25T13:17:02.814084+0000","last_peered":"2024-04-25T13:17:02.814084+0000","last_clean":"2024-04-25T13:17:02.814084+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:17:02.814084+0000","last_undegraded":"2024-04-25T13:17:02.814084+0000","last_fullsized":"2024-04-25T13:17:02.814084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:04.652219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:04.814176+0000","last_change":"2024-04-25T13:16:20.666601+0000","last_active":"2024-04-25T13:17:04.814176+0000","last_peered":"2024-04-25T13:17:04.814176+0000","last_clean":"2024-04-25T13:17:04.814176+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:17:04.814176+0000","last_undegraded":"2024-04-25T13:17:04.814176+0000","last_fullsized":"2024-04-25T13:17:04.814176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:06.613183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.208826+0000","last_change":"2024-04-25T13:17:33.208860+0000","last_active":"2024-04-25T13:17:33.208826+0000","last_peered":"2024-04-25T13:17:33.208826+0000","last_clean":"2024-04-25T13:17:33.208826+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:17:33.208826+0000","last_undegraded":"2024-04-25T13:17:33.208826+0000","last_fullsized":"2024-04-25T13:17:33.208826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.208729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.208729+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.208729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:26.219325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815736+0000","last_change":"2024-04-25T13:16:25.711928+0000","last_active":"2024-04-25T13:17:02.815736+0000","last_peered":"2024-04-25T13:17:02.815736+0000","last_clean":"2024-04-25T13:17:02.815736+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:17:02.815736+0000","last_undegraded":"2024-04-25T13:17:02.815736+0000","last_fullsized":"2024-04-25T13:17:02.815736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:19.118875+0000","last_change":"2024-04-25T13:16:20.658557+0000","last_active":"2024-04-25T13:17:19.118875+0000","last_peered":"2024-04-25T13:17:19.118875+0000","last_clean":"2024-04-25T13:17:19.118875+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:17:19.118875+0000","last_undegraded":"2024-04-25T13:17:19.118875+0000","last_fullsized":"2024-04-25T13:17:19.118875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:19.634785+0000","last_clean_scrub_stamp":"2024-04-25T13:16:19.634785+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:33.542648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507498+0000","last_change":"2024-04-25T13:16:21.674786+0000","last_active":"2024-04-25T13:17:03.507498+0000","last_peered":"2024-04-25T13:17:03.507498+0000","last_clean":"2024-04-25T13:17:03.507498+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:17:03.507498+0000","last_undegraded":"2024-04-25T13:17:03.507498+0000","last_fullsized":"2024-04-25T13:17:03.507498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:45.172626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812540+0000","last_change":"2024-04-25T13:16:25.715619+0000","last_active":"2024-04-25T13:17:02.812540+0000","last_peered":"2024-04-25T13:17:02.812540+0000","last_clean":"2024-04-25T13:17:02.812540+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:17:02.812540+0000","last_undegraded":"2024-04-25T13:17:02.812540+0000","last_fullsized":"2024-04-25T13:17:02.812540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:24.670618+0000","last_clean_scrub_stamp":"2024-04-25T13:16:24.670618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:05.006114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508013+0000","last_change":"2024-04-25T13:16:21.678490+0000","last_active":"2024-04-25T13:17:03.508013+0000","last_peered":"2024-04-25T13:17:03.508013+0000","last_clean":"2024-04-25T13:17:03.508013+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:17:03.508013+0000","last_undegraded":"2024-04-25T13:17:03.508013+0000","last_fullsized":"2024-04-25T13:17:03.508013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.304626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815906+0000","last_change":"2024-04-25T13:16:21.668421+0000","last_active":"2024-04-25T13:17:02.815906+0000","last_peered":"2024-04-25T13:17:02.815906+0000","last_clean":"2024-04-25T13:17:02.815906+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:17:02.815906+0000","last_undegraded":"2024-04-25T13:17:02.815906+0000","last_fullsized":"2024-04-25T13:17:02.815906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813541+0000","last_change":"2024-04-25T13:16:21.669167+0000","last_active":"2024-04-25T13:17:02.813541+0000","last_peered":"2024-04-25T13:17:02.813541+0000","last_clean":"2024-04-25T13:17:02.813541+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:17:02.813541+0000","last_undegraded":"2024-04-25T13:17:02.813541+0000","last_fullsized":"2024-04-25T13:17:02.813541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.353905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816332+0000","last_change":"2024-04-25T13:16:21.673177+0000","last_active":"2024-04-25T13:17:02.816332+0000","last_peered":"2024-04-25T13:17:02.816332+0000","last_clean":"2024-04-25T13:17:02.816332+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:17:02.816332+0000","last_undegraded":"2024-04-25T13:17:02.816332+0000","last_fullsized":"2024-04-25T13:17:02.816332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812966+0000","last_change":"2024-04-25T13:16:21.674846+0000","last_active":"2024-04-25T13:17:02.812966+0000","last_peered":"2024-04-25T13:17:02.812966+0000","last_clean":"2024-04-25T13:17:02.812966+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:17:02.812966+0000","last_undegraded":"2024-04-25T13:17:02.812966+0000","last_fullsized":"2024-04-25T13:17:02.812966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:06:10.043280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815246+0000","last_change":"2024-04-25T13:16:21.667573+0000","last_active":"2024-04-25T13:17:02.815246+0000","last_peered":"2024-04-25T13:17:02.815246+0000","last_clean":"2024-04-25T13:17:02.815246+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:17:02.815246+0000","last_undegraded":"2024-04-25T13:17:02.815246+0000","last_fullsized":"2024-04-25T13:17:02.815246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508661+0000","last_change":"2024-04-25T13:16:21.679434+0000","last_active":"2024-04-25T13:17:03.508661+0000","last_peered":"2024-04-25T13:17:03.508661+0000","last_clean":"2024-04-25T13:17:03.508661+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:17:03.508661+0000","last_undegraded":"2024-04-25T13:17:03.508661+0000","last_fullsized":"2024-04-25T13:17:03.508661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:57.113656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812859+0000","last_change":"2024-04-25T13:16:21.681722+0000","last_active":"2024-04-25T13:17:02.812859+0000","last_peered":"2024-04-25T13:17:02.812859+0000","last_clean":"2024-04-25T13:17:02.812859+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:17:02.812859+0000","last_undegraded":"2024-04-25T13:17:02.812859+0000","last_fullsized":"2024-04-25T13:17:02.812859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:28.891480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813154+0000","last_change":"2024-04-25T13:16:21.673098+0000","last_active":"2024-04-25T13:17:02.813154+0000","last_peered":"2024-04-25T13:17:02.813154+0000","last_clean":"2024-04-25T13:17:02.813154+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:17:02.813154+0000","last_undegraded":"2024-04-25T13:17:02.813154+0000","last_fullsized":"2024-04-25T13:17:02.813154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:36.623884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812212+0000","last_change":"2024-04-25T13:16:21.674696+0000","last_active":"2024-04-25T13:17:02.812212+0000","last_peered":"2024-04-25T13:17:02.812212+0000","last_clean":"2024-04-25T13:17:02.812212+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:17:02.812212+0000","last_undegraded":"2024-04-25T13:17:02.812212+0000","last_fullsized":"2024-04-25T13:17:02.812212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:20.969043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813496+0000","last_change":"2024-04-25T13:16:21.665727+0000","last_active":"2024-04-25T13:17:02.813496+0000","last_peered":"2024-04-25T13:17:02.813496+0000","last_clean":"2024-04-25T13:17:02.813496+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:17:02.813496+0000","last_undegraded":"2024-04-25T13:17:02.813496+0000","last_fullsized":"2024-04-25T13:17:02.813496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:35.019836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816133+0000","last_change":"2024-04-25T13:16:21.670469+0000","last_active":"2024-04-25T13:17:02.816133+0000","last_peered":"2024-04-25T13:17:02.816133+0000","last_clean":"2024-04-25T13:17:02.816133+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:17:02.816133+0000","last_undegraded":"2024-04-25T13:17:02.816133+0000","last_fullsized":"2024-04-25T13:17:02.816133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508097+0000","last_change":"2024-04-25T13:16:21.680527+0000","last_active":"2024-04-25T13:17:03.508097+0000","last_peered":"2024-04-25T13:17:03.508097+0000","last_clean":"2024-04-25T13:17:03.508097+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:17:03.508097+0000","last_undegraded":"2024-04-25T13:17:03.508097+0000","last_fullsized":"2024-04-25T13:17:03.508097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.466620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812095+0000","last_change":"2024-04-25T13:16:21.671180+0000","last_active":"2024-04-25T13:17:02.812095+0000","last_peered":"2024-04-25T13:17:02.812095+0000","last_clean":"2024-04-25T13:17:02.812095+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:17:02.812095+0000","last_undegraded":"2024-04-25T13:17:02.812095+0000","last_fullsized":"2024-04-25T13:17:02.812095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.063765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.816842+0000","last_change":"2024-04-25T13:16:21.676079+0000","last_active":"2024-04-25T13:17:02.816842+0000","last_peered":"2024-04-25T13:17:02.816842+0000","last_clean":"2024-04-25T13:17:02.816842+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.816842+0000","last_undegraded":"2024-04-25T13:17:02.816842+0000","last_fullsized":"2024-04-25T13:17:02.816842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.640047+0000","last_change":"2024-04-25T13:17:02.818074+0000","last_active":"2024-04-25T13:17:03.640047+0000","last_peered":"2024-04-25T13:17:03.640047+0000","last_clean":"2024-04-25T13:17:03.640047+0000","last_became_active":"2024-04-25T13:17:02.817489+0000","last_became_peered":"2024-04-25T13:17:02.817489+0000","last_unstale":"2024-04-25T13:17:03.640047+0000","last_undegraded":"2024-04-25T13:17:03.640047+0000","last_fullsized":"2024-04-25T13:17:03.640047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813129+0000","last_change":"2024-04-25T13:16:21.669626+0000","last_active":"2024-04-25T13:17:02.813129+0000","last_peered":"2024-04-25T13:17:02.813129+0000","last_clean":"2024-04-25T13:17:02.813129+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:17:02.813129+0000","last_undegraded":"2024-04-25T13:17:02.813129+0000","last_fullsized":"2024-04-25T13:17:02.813129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:13.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813451+0000","last_change":"2024-04-25T13:16:21.676387+0000","last_active":"2024-04-25T13:17:02.813451+0000","last_peered":"2024-04-25T13:17:02.813451+0000","last_clean":"2024-04-25T13:17:02.813451+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:17:02.813451+0000","last_undegraded":"2024-04-25T13:17:02.813451+0000","last_fullsized":"2024-04-25T13:17:02.813451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815942+0000","last_change":"2024-04-25T13:16:21.671862+0000","last_active":"2024-04-25T13:17:02.815942+0000","last_peered":"2024-04-25T13:17:02.815942+0000","last_clean":"2024-04-25T13:17:02.815942+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:17:02.815942+0000","last_undegraded":"2024-04-25T13:17:02.815942+0000","last_fullsized":"2024-04-25T13:17:02.815942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811962+0000","last_change":"2024-04-25T13:16:21.677271+0000","last_active":"2024-04-25T13:17:02.811962+0000","last_peered":"2024-04-25T13:17:02.811962+0000","last_clean":"2024-04-25T13:17:02.811962+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:02.811962+0000","last_undegraded":"2024-04-25T13:17:02.811962+0000","last_fullsized":"2024-04-25T13:17:02.811962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:32.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.507772+0000","last_change":"2024-04-25T13:16:21.677144+0000","last_active":"2024-04-25T13:17:03.507772+0000","last_peered":"2024-04-25T13:17:03.507772+0000","last_clean":"2024-04-25T13:17:03.507772+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:17:03.507772+0000","last_undegraded":"2024-04-25T13:17:03.507772+0000","last_fullsized":"2024-04-25T13:17:03.507772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:25.446587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508579+0000","last_change":"2024-04-25T13:16:21.682025+0000","last_active":"2024-04-25T13:17:03.508579+0000","last_peered":"2024-04-25T13:17:03.508579+0000","last_clean":"2024-04-25T13:17:03.508579+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:17:03.508579+0000","last_undegraded":"2024-04-25T13:17:03.508579+0000","last_fullsized":"2024-04-25T13:17:03.508579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:21.928180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.508564+0000","last_change":"2024-04-25T13:16:21.681661+0000","last_active":"2024-04-25T13:17:03.508564+0000","last_peered":"2024-04-25T13:17:03.508564+0000","last_clean":"2024-04-25T13:17:03.508564+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:17:03.508564+0000","last_undegraded":"2024-04-25T13:17:03.508564+0000","last_fullsized":"2024-04-25T13:17:03.508564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:41:27.263693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:03.640038+0000","last_change":"2024-04-25T13:17:02.819234+0000","last_active":"2024-04-25T13:17:03.640038+0000","last_peered":"2024-04-25T13:17:03.640038+0000","last_clean":"2024-04-25T13:17:03.640038+0000","last_became_active":"2024-04-25T13:17:02.818740+0000","last_became_peered":"2024-04-25T13:17:02.818740+0000","last_unstale":"2024-04-25T13:17:03.640038+0000","last_undegraded":"2024-04-25T13:17:03.640038+0000","last_fullsized":"2024-04-25T13:17:03.640038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811710+0000","last_change":"2024-04-25T13:16:21.675246+0000","last_active":"2024-04-25T13:17:02.811710+0000","last_peered":"2024-04-25T13:17:02.811710+0000","last_clean":"2024-04-25T13:17:02.811710+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:17:02.811710+0000","last_undegraded":"2024-04-25T13:17:02.811710+0000","last_fullsized":"2024-04-25T13:17:02.811710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:26.134729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811344+0000","last_change":"2024-04-25T13:16:21.667740+0000","last_active":"2024-04-25T13:17:02.811344+0000","last_peered":"2024-04-25T13:17:02.811344+0000","last_clean":"2024-04-25T13:17:02.811344+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:17:02.811344+0000","last_undegraded":"2024-04-25T13:17:02.811344+0000","last_fullsized":"2024-04-25T13:17:02.811344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:10.797267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813459+0000","last_change":"2024-04-25T13:16:21.669311+0000","last_active":"2024-04-25T13:17:02.813459+0000","last_peered":"2024-04-25T13:17:02.813459+0000","last_clean":"2024-04-25T13:17:02.813459+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:17:02.813459+0000","last_undegraded":"2024-04-25T13:17:02.813459+0000","last_fullsized":"2024-04-25T13:17:02.813459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:04:44.316560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.811565+0000","last_change":"2024-04-25T13:16:21.669994+0000","last_active":"2024-04-25T13:17:02.811565+0000","last_peered":"2024-04-25T13:17:02.811565+0000","last_clean":"2024-04-25T13:17:02.811565+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:17:02.811565+0000","last_undegraded":"2024-04-25T13:17:02.811565+0000","last_fullsized":"2024-04-25T13:17:02.811565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:30:31.269162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.813964+0000","last_change":"2024-04-25T13:16:21.673325+0000","last_active":"2024-04-25T13:17:02.813964+0000","last_peered":"2024-04-25T13:17:02.813964+0000","last_clean":"2024-04-25T13:17:02.813964+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:17:02.813964+0000","last_undegraded":"2024-04-25T13:17:02.813964+0000","last_fullsized":"2024-04-25T13:17:02.813964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:04.768682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815039+0000","last_change":"2024-04-25T13:16:21.670000+0000","last_active":"2024-04-25T13:17:02.815039+0000","last_peered":"2024-04-25T13:17:02.815039+0000","last_clean":"2024-04-25T13:17:02.815039+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:17:02.815039+0000","last_undegraded":"2024-04-25T13:17:02.815039+0000","last_fullsized":"2024-04-25T13:17:02.815039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.815964+0000","last_change":"2024-04-25T13:16:21.667674+0000","last_active":"2024-04-25T13:17:02.815964+0000","last_peered":"2024-04-25T13:17:02.815964+0000","last_clean":"2024-04-25T13:17:02.815964+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:17:02.815964+0000","last_undegraded":"2024-04-25T13:17:02.815964+0000","last_fullsized":"2024-04-25T13:17:02.815964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:02.812114+0000","last_change":"2024-04-25T13:16:21.676353+0000","last_active":"2024-04-25T13:17:02.812114+0000","last_peered":"2024-04-25T13:17:02.812114+0000","last_clean":"2024-04-25T13:17:02.812114+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:17:02.812114+0000","last_undegraded":"2024-04-25T13:17:02.812114+0000","last_fullsized":"2024-04-25T13:17:02.812114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:16:20.638681+0000","last_clean_scrub_stamp":"2024-04-25T13:16:20.638681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:54.150139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":123554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":120952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":124870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":121084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":710282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:36.052 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.052 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.052 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.053 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.053 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.053 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.053 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.053 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.053 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.054 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.054 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.054 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.054 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.054 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.054 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.055 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.055 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.055 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.055 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.055 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.055 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.056 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.056 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.056 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.056 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.056 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.056 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.057 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.058 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.058 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.058 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.058 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.058 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.058 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.059 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.060 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T13:16:10.615139+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=10, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.060 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.060 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.060 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.060 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.060 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.061 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.061 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.061 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.061 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.061 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.061 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.062 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.062 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.062 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.062 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.062 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.062 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.063 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.064 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.064 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.064 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.064 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.064 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.064 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.065 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.065 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.065 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.065 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.065 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.065 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.066 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.066 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.066 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.066 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.066 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.066 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.067 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.067 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.067 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.067 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T13:16:19.634785+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=19, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.067 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.067 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T13:16:24.670618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.068 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.069 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.069 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.069 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.069 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.069 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.069 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.070 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.070 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.070 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.070 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.070 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.070 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.071 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.071 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.071 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.071 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.071 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.071 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.072 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T13:16:20.638681+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=16, tm_sec=20, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=17, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:17:36.073 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:17:42.053 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:42.056 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:17:56.073 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:17:56.183 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.183+0000 7ff886b56640 1 Processor -- start 2024-04-25T13:17:56.184 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.183+0000 7ff886b56640 1 -- start start 2024-04-25T13:17:56.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff886b56640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7ff8801553a0 0x7ff88015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.186 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff886b56640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8800c8420 0x7ff8800c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff886b56640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8800c7970 con 0x7ff8800c9440 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff886b56640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff88006d730 con 0x7ff8800c8420 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff886b56640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7ff88015c0a0 con 0x7ff8801553a0 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff8850f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8800c8420 0x7ff8800c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff8850f3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff8800c8420 0x7ff8800c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53542/0 (socket says 172.21.15.155:53542) 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff8850f3640 1 -- 172.21.15.155:0/1227157285 learned_addr learned my addr 172.21.15.155:0/1227157285 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.184+0000 7ff87ffff640 1 --1- 172.21.15.155:0/1227157285 >> v1:172.21.15.155:6789/0 conn(0x7ff8800c9440 0x7ff88006d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54140/0 (socket says 172.21.15.155:54140) 2024-04-25T13:17:56.187 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8848f2640 1 --2- 172.21.15.155:0/1227157285 >> v2:172.21.15.191:3300/0 conn(0x7ff8801553a0 0x7ff88015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8850f3640 1 -- 172.21.15.155:0/1227157285 >> v2:172.21.15.191:3300/0 conn(0x7ff8801553a0 msgr2=0x7ff88015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8850f3640 1 --2- 172.21.15.155:0/1227157285 >> v2:172.21.15.191:3300/0 conn(0x7ff8801553a0 0x7ff88015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8850f3640 1 -- 172.21.15.155:0/1227157285 >> v1:172.21.15.155:6789/0 conn(0x7ff8800c9440 legacy=0x7ff88006d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8850f3640 1 -- 172.21.15.155:0/1227157285 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8800c9190 con 0x7ff8800c8420 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8848f2640 1 --2- 172.21.15.155:0/1227157285 >> v2:172.21.15.191:3300/0 conn(0x7ff8801553a0 0x7ff88015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff8850f3640 1 --2- 172.21.15.155:0/1227157285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8800c8820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff880075b70 tx=0x7ff87802a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260d598654ac1d10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.185+0000 7ff87f7fe640 1 -- 172.21.15.155:0/1227157285 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878036070 con 0x7ff8800c8420 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff87f7fe640 1 -- 172.21.15.155:0/1227157285 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff878031600 con 0x7ff8800c8420 2024-04-25T13:17:56.188 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff87f7fe640 1 -- 172.21.15.155:0/1227157285 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8780319d0 con 0x7ff8800c8420 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 -- 172.21.15.155:0/1227157285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 msgr2=0x7ff8800c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 --2- 172.21.15.155:0/1227157285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8800c8820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff880075b70 tx=0x7ff87802a7f0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 -- 172.21.15.155:0/1227157285 shutdown_connections 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 --2- 172.21.15.155:0/1227157285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8800c8820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 --2- 172.21.15.155:0/1227157285 >> v2:172.21.15.191:3300/0 conn(0x7ff8801553a0 0x7ff88015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 -- 172.21.15.155:0/1227157285 >> 172.21.15.155:0/1227157285 conn(0x7ff8800c9a70 msgr2=0x7ff8800c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 -- 172.21.15.155:0/1227157285 shutdown_connections 2024-04-25T13:17:56.189 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.186+0000 7ff886b56640 1 -- 172.21.15.155:0/1227157285 wait complete. 2024-04-25T13:17:56.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.187+0000 7ff886b56640 1 Processor -- start 2024-04-25T13:17:56.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.187+0000 7ff886b56640 1 -- start start 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff886b56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8801590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff886b56640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8800c9440 0x7ff880159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff886b56640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8801553a0 0x7ff88015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff886b56640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8800c7f20 con 0x7ff8800c8420 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff886b56640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff88015efa0 con 0x7ff8801553a0 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff886b56640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff88015e670 con 0x7ff8800c9440 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff8848f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8801590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff8848f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8801590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53544/0 (socket says 172.21.15.155:53544) 2024-04-25T13:17:56.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.188+0000 7ff8848f2640 1 -- 172.21.15.155:0/3064824166 learned_addr learned my addr 172.21.15.155:0/3064824166 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8850f3640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8801553a0 0x7ff88015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8848f2640 1 -- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8800c9440 msgr2=0x7ff880159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff87ffff640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8800c9440 0x7ff880159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8848f2640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8800c9440 0x7ff880159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8848f2640 1 -- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8801553a0 msgr2=0x7ff88015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8848f2640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8801553a0 0x7ff88015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8848f2640 1 -- 172.21.15.155:0/3064824166 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8801e45a0 con 0x7ff8800c8420 2024-04-25T13:17:56.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8850f3640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8801553a0 0x7ff88015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff8848f2640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8801590c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff87000d7d0 tx=0x7ff87000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870004030 con 0x7ff8800c8420 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8700041d0 con 0x7ff8800c8420 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700096a0 con 0x7ff8800c8420 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff880159c30 con 0x7ff8800c8420 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.189+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88015a1d0 con 0x7ff8800c8420 2024-04-25T13:17:56.195 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.190+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff880068e40 con 0x7ff8800c8420 2024-04-25T13:17:56.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.190+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff870009840 con 0x7ff8800c8420 2024-04-25T13:17:56.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.191+0000 7ff87d7fa640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff86c06c8f0 0x7ff86c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.191+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff87008c150 con 0x7ff8800c8420 2024-04-25T13:17:56.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.191+0000 7ff87ffff640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff86c06c8f0 0x7ff86c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.191+0000 7ff87ffff640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff86c06c8f0 0x7ff86c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff880158d80 tx=0x7ff874009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.196 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.195+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff87005a210 con 0x7ff8800c8420 2024-04-25T13:17:56.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.364+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 --> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff880152c50 con 0x7ff86c06c8f0 2024-04-25T13:17:56.371 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.372+0000 7ff87d7fa640 1 -- 172.21.15.155:0/3064824166 <== mgr.4104 v2:172.21.15.155:6832/235379904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332769 (secure 0 0 0) 0x7ff880152c50 con 0x7ff86c06c8f0 2024-04-25T13:17:56.375 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:56.377 INFO:teuthology.orchestra.run.smithi155.stderr:dumped all 2024-04-25T13:17:56.378 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff86c06c8f0 msgr2=0x7ff86c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff86c06c8f0 0x7ff86c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff880158d80 tx=0x7ff874009040 comp rx=0 tx=0).stop 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 msgr2=0x7ff8801590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8801590c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff87000d7d0 tx=0x7ff87000dc90 comp rx=0 tx=0).stop 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 shutdown_connections 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff8801553a0 0x7ff88015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff86c06c8f0 0x7ff86c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff8800c9440 0x7ff880159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 --2- 172.21.15.155:0/3064824166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8800c8420 0x7ff8801590c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.379 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 >> 172.21.15.155:0/3064824166 conn(0x7ff8800c9a70 msgr2=0x7ff880152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 shutdown_connections 2024-04-25T13:17:56.380 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.375+0000 7ff886b56640 1 -- 172.21.15.155:0/3064824166 wait complete. 2024-04-25T13:17:56.386 INFO:teuthology.orchestra.run.smithi155.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-04-25T13:17:55.638851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602960,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":379,"num_write_kb":2494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219816,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754904,"statfs":{"total":773094113280,"available":772869021696,"internally_reserved":0,"allocated":3776512,"data_stored":2158240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20000,"num_omap_keys":40,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003411"},"pg_stats":[{"pgid":"2.1f","version":"27'17","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.172900+0000","last_change":"2024-04-25T13:17:34.172951+0000","last_active":"2024-04-25T13:17:34.172900+0000","last_peered":"2024-04-25T13:17:34.172900+0000","last_clean":"2024-04-25T13:17:34.172900+0000","last_became_active":"2024-04-25T13:16:20.660170+0000","last_became_peered":"2024-04-25T13:16:20.660170+0000","last_unstale":"2024-04-25T13:17:34.172900+0000","last_undegraded":"2024-04-25T13:17:34.172900+0000","last_fullsized":"2024-04-25T13:17:34.172900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-04-25T13:17:34.172822+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-04-25T13:17:34.172822+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.172822+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:26:59.713239+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:49.802832+0000","last_change":"2024-04-25T13:17:49.802864+0000","last_active":"2024-04-25T13:17:49.802832+0000","last_peered":"2024-04-25T13:17:49.802832+0000","last_clean":"2024-04-25T13:17:49.802832+0000","last_became_active":"2024-04-25T13:17:03.509296+0000","last_became_peered":"2024-04-25T13:17:03.509296+0000","last_unstale":"2024-04-25T13:17:49.802832+0000","last_undegraded":"2024-04-25T13:17:49.802832+0000","last_fullsized":"2024-04-25T13:17:49.802832+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:49.802718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:49.802718+0000","last_clean_scrub_stamp":"2024-04-25T13:17:49.802718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:00.015187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:49.539396+0000","last_change":"2024-04-25T13:17:49.539423+0000","last_active":"2024-04-25T13:17:49.539396+0000","last_peered":"2024-04-25T13:17:49.539396+0000","last_clean":"2024-04-25T13:17:49.539396+0000","last_became_active":"2024-04-25T13:16:25.709682+0000","last_became_peered":"2024-04-25T13:16:25.709682+0000","last_unstale":"2024-04-25T13:17:49.539396+0000","last_undegraded":"2024-04-25T13:17:49.539396+0000","last_fullsized":"2024-04-25T13:17:49.539396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:49.539313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:49.539313+0000","last_clean_scrub_stamp":"2024-04-25T13:17:49.539313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:15:08.911362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.611278+0000","last_change":"2024-04-25T13:17:39.611320+0000","last_active":"2024-04-25T13:17:39.611278+0000","last_peered":"2024-04-25T13:17:39.611278+0000","last_clean":"2024-04-25T13:17:39.611278+0000","last_became_active":"2024-04-25T13:16:20.662022+0000","last_became_peered":"2024-04-25T13:16:20.662022+0000","last_unstale":"2024-04-25T13:17:39.611278+0000","last_undegraded":"2024-04-25T13:17:39.611278+0000","last_fullsized":"2024-04-25T13:17:39.611278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-25T13:17:39.611148+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-25T13:17:39.611148+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.611148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:00.969686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.064521+0000","last_change":"2024-04-25T13:17:43.064558+0000","last_active":"2024-04-25T13:17:43.064521+0000","last_peered":"2024-04-25T13:17:43.064521+0000","last_clean":"2024-04-25T13:17:43.064521+0000","last_became_active":"2024-04-25T13:16:21.680019+0000","last_became_peered":"2024-04-25T13:16:21.680019+0000","last_unstale":"2024-04-25T13:17:43.064521+0000","last_undegraded":"2024-04-25T13:17:43.064521+0000","last_fullsized":"2024-04-25T13:17:43.064521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.064398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.064398+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.064398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:17.670442+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.646634+0000","last_change":"2024-04-25T13:17:46.646659+0000","last_active":"2024-04-25T13:17:46.646634+0000","last_peered":"2024-04-25T13:17:46.646634+0000","last_clean":"2024-04-25T13:17:46.646634+0000","last_became_active":"2024-04-25T13:16:25.711451+0000","last_became_peered":"2024-04-25T13:16:25.711451+0000","last_unstale":"2024-04-25T13:17:46.646634+0000","last_undegraded":"2024-04-25T13:17:46.646634+0000","last_fullsized":"2024-04-25T13:17:46.646634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.646535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.646535+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.646535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:09.575250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.373637+0000","last_change":"2024-04-25T13:17:41.373677+0000","last_active":"2024-04-25T13:17:41.373637+0000","last_peered":"2024-04-25T13:17:41.373637+0000","last_clean":"2024-04-25T13:17:41.373637+0000","last_became_active":"2024-04-25T13:16:20.663177+0000","last_became_peered":"2024-04-25T13:16:20.663177+0000","last_unstale":"2024-04-25T13:17:41.373637+0000","last_undegraded":"2024-04-25T13:17:41.373637+0000","last_fullsized":"2024-04-25T13:17:41.373637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-04-25T13:17:41.373554+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-04-25T13:17:41.373554+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.373554+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:26:36.368218+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:49.292997+0000","last_change":"2024-04-25T13:17:49.293020+0000","last_active":"2024-04-25T13:17:49.292997+0000","last_peered":"2024-04-25T13:17:49.292997+0000","last_clean":"2024-04-25T13:17:49.292997+0000","last_became_active":"2024-04-25T13:16:21.674641+0000","last_became_peered":"2024-04-25T13:16:21.674641+0000","last_unstale":"2024-04-25T13:17:49.292997+0000","last_undegraded":"2024-04-25T13:17:49.292997+0000","last_fullsized":"2024-04-25T13:17:49.292997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:49.292904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:49.292904+0000","last_clean_scrub_stamp":"2024-04-25T13:17:49.292904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:41.429263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.516592+0000","last_change":"2024-04-25T13:17:42.516632+0000","last_active":"2024-04-25T13:17:42.516592+0000","last_peered":"2024-04-25T13:17:42.516592+0000","last_clean":"2024-04-25T13:17:42.516592+0000","last_became_active":"2024-04-25T13:16:25.702095+0000","last_became_peered":"2024-04-25T13:16:25.702095+0000","last_unstale":"2024-04-25T13:17:42.516592+0000","last_undegraded":"2024-04-25T13:17:42.516592+0000","last_fullsized":"2024-04-25T13:17:42.516592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.516481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.516481+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.516481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:23.166536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.376507+0000","last_change":"2024-04-25T13:17:43.376573+0000","last_active":"2024-04-25T13:17:43.376507+0000","last_peered":"2024-04-25T13:17:43.376507+0000","last_clean":"2024-04-25T13:17:43.376507+0000","last_became_active":"2024-04-25T13:16:20.664930+0000","last_became_peered":"2024-04-25T13:16:20.664930+0000","last_unstale":"2024-04-25T13:17:43.376507+0000","last_undegraded":"2024-04-25T13:17:43.376507+0000","last_fullsized":"2024-04-25T13:17:43.376507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T13:17:43.376415+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T13:17:43.376415+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.376415+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:35.664472+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.248809+0000","last_change":"2024-04-25T13:17:48.248834+0000","last_active":"2024-04-25T13:17:48.248809+0000","last_peered":"2024-04-25T13:17:48.248809+0000","last_clean":"2024-04-25T13:17:48.248809+0000","last_became_active":"2024-04-25T13:16:21.674533+0000","last_became_peered":"2024-04-25T13:16:21.674533+0000","last_unstale":"2024-04-25T13:17:48.248809+0000","last_undegraded":"2024-04-25T13:17:48.248809+0000","last_fullsized":"2024-04-25T13:17:48.248809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.248721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.248721+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.248721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:31.970149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.605701+0000","last_change":"2024-04-25T13:17:44.605756+0000","last_active":"2024-04-25T13:17:44.605701+0000","last_peered":"2024-04-25T13:17:44.605701+0000","last_clean":"2024-04-25T13:17:44.605701+0000","last_became_active":"2024-04-25T13:16:25.706975+0000","last_became_peered":"2024-04-25T13:16:25.706975+0000","last_unstale":"2024-04-25T13:17:44.605701+0000","last_undegraded":"2024-04-25T13:17:44.605701+0000","last_fullsized":"2024-04-25T13:17:44.605701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.605612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.605612+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.605612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:45.763766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.490321+0000","last_change":"2024-04-25T13:17:44.490345+0000","last_active":"2024-04-25T13:17:44.490321+0000","last_peered":"2024-04-25T13:17:44.490321+0000","last_clean":"2024-04-25T13:17:44.490321+0000","last_became_active":"2024-04-25T13:16:21.680693+0000","last_became_peered":"2024-04-25T13:16:21.680693+0000","last_unstale":"2024-04-25T13:17:44.490321+0000","last_undegraded":"2024-04-25T13:17:44.490321+0000","last_fullsized":"2024-04-25T13:17:44.490321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.490229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.490229+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.490229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:21.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.350119+0000","last_change":"2024-04-25T13:17:38.350170+0000","last_active":"2024-04-25T13:17:38.350119+0000","last_peered":"2024-04-25T13:17:38.350119+0000","last_clean":"2024-04-25T13:17:38.350119+0000","last_became_active":"2024-04-25T13:16:20.656051+0000","last_became_peered":"2024-04-25T13:16:20.656051+0000","last_unstale":"2024-04-25T13:17:38.350119+0000","last_undegraded":"2024-04-25T13:17:38.350119+0000","last_fullsized":"2024-04-25T13:17:38.350119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:38.350013+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:38.350013+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.350013+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.938409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.509484+0000","last_change":"2024-04-25T13:17:40.509524+0000","last_active":"2024-04-25T13:17:40.509484+0000","last_peered":"2024-04-25T13:17:40.509484+0000","last_clean":"2024-04-25T13:17:40.509484+0000","last_became_active":"2024-04-25T13:16:25.699367+0000","last_became_peered":"2024-04-25T13:16:25.699367+0000","last_unstale":"2024-04-25T13:17:40.509484+0000","last_undegraded":"2024-04-25T13:17:40.509484+0000","last_fullsized":"2024-04-25T13:17:40.509484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.509369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.509369+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.509369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:16.597273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.561603+0000","last_change":"2024-04-25T13:17:44.561627+0000","last_active":"2024-04-25T13:17:44.561603+0000","last_peered":"2024-04-25T13:17:44.561603+0000","last_clean":"2024-04-25T13:17:44.561603+0000","last_became_active":"2024-04-25T13:16:21.671530+0000","last_became_peered":"2024-04-25T13:16:21.671530+0000","last_unstale":"2024-04-25T13:17:44.561603+0000","last_undegraded":"2024-04-25T13:17:44.561603+0000","last_fullsized":"2024-04-25T13:17:44.561603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.561484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.561484+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.561484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:00.674358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.832515+0000","last_change":"2024-04-25T13:17:34.832556+0000","last_active":"2024-04-25T13:17:34.832515+0000","last_peered":"2024-04-25T13:17:34.832515+0000","last_clean":"2024-04-25T13:17:34.832515+0000","last_became_active":"2024-04-25T13:16:20.656309+0000","last_became_peered":"2024-04-25T13:16:20.656309+0000","last_unstale":"2024-04-25T13:17:34.832515+0000","last_undegraded":"2024-04-25T13:17:34.832515+0000","last_fullsized":"2024-04-25T13:17:34.832515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:34.832414+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:34.832414+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.832414+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:50.963833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.612338+0000","last_change":"2024-04-25T13:17:48.612373+0000","last_active":"2024-04-25T13:17:48.612338+0000","last_peered":"2024-04-25T13:17:48.612338+0000","last_clean":"2024-04-25T13:17:48.612338+0000","last_became_active":"2024-04-25T13:16:25.717639+0000","last_became_peered":"2024-04-25T13:16:25.717639+0000","last_unstale":"2024-04-25T13:17:48.612338+0000","last_undegraded":"2024-04-25T13:17:48.612338+0000","last_fullsized":"2024-04-25T13:17:48.612338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.612252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.612252+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.612252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:18.398086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.541508+0000","last_change":"2024-04-25T13:17:42.541534+0000","last_active":"2024-04-25T13:17:42.541508+0000","last_peered":"2024-04-25T13:17:42.541508+0000","last_clean":"2024-04-25T13:17:42.541508+0000","last_became_active":"2024-04-25T13:16:21.667012+0000","last_became_peered":"2024-04-25T13:16:21.667012+0000","last_unstale":"2024-04-25T13:17:42.541508+0000","last_undegraded":"2024-04-25T13:17:42.541508+0000","last_fullsized":"2024-04-25T13:17:42.541508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.541423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.541423+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.541423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:14.711830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.850965+0000","last_change":"2024-04-25T13:17:35.850996+0000","last_active":"2024-04-25T13:17:35.850965+0000","last_peered":"2024-04-25T13:17:35.850965+0000","last_clean":"2024-04-25T13:17:35.850965+0000","last_became_active":"2024-04-25T13:16:20.657186+0000","last_became_peered":"2024-04-25T13:16:20.657186+0000","last_unstale":"2024-04-25T13:17:35.850965+0000","last_undegraded":"2024-04-25T13:17:35.850965+0000","last_fullsized":"2024-04-25T13:17:35.850965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:35.850891+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:35.850891+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.850891+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:27:34.354080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.836489+0000","last_change":"2024-04-25T13:17:48.836532+0000","last_active":"2024-04-25T13:17:48.836489+0000","last_peered":"2024-04-25T13:17:48.836489+0000","last_clean":"2024-04-25T13:17:48.836489+0000","last_became_active":"2024-04-25T13:16:25.713333+0000","last_became_peered":"2024-04-25T13:16:25.713333+0000","last_unstale":"2024-04-25T13:17:48.836489+0000","last_undegraded":"2024-04-25T13:17:48.836489+0000","last_fullsized":"2024-04-25T13:17:48.836489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.836380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.836380+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.836380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:58.485239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.571803+0000","last_change":"2024-04-25T13:17:35.571849+0000","last_active":"2024-04-25T13:17:35.571803+0000","last_peered":"2024-04-25T13:17:35.571803+0000","last_clean":"2024-04-25T13:17:35.571803+0000","last_became_active":"2024-04-25T13:16:21.669185+0000","last_became_peered":"2024-04-25T13:16:21.669185+0000","last_unstale":"2024-04-25T13:17:35.571803+0000","last_undegraded":"2024-04-25T13:17:35.571803+0000","last_fullsized":"2024-04-25T13:17:35.571803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.571701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.571701+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.571701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:31.570563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.340258+0000","last_change":"2024-04-25T13:17:40.340317+0000","last_active":"2024-04-25T13:17:40.340258+0000","last_peered":"2024-04-25T13:17:40.340258+0000","last_clean":"2024-04-25T13:17:40.340258+0000","last_became_active":"2024-04-25T13:16:20.662450+0000","last_became_peered":"2024-04-25T13:16:20.662450+0000","last_unstale":"2024-04-25T13:17:40.340258+0000","last_undegraded":"2024-04-25T13:17:40.340258+0000","last_fullsized":"2024-04-25T13:17:40.340258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T13:17:40.340149+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T13:17:40.340149+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.340149+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:44.199558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.623139+0000","last_change":"2024-04-25T13:17:45.623166+0000","last_active":"2024-04-25T13:17:45.623139+0000","last_peered":"2024-04-25T13:17:45.623139+0000","last_clean":"2024-04-25T13:17:45.623139+0000","last_became_active":"2024-04-25T13:16:25.706838+0000","last_became_peered":"2024-04-25T13:16:25.706838+0000","last_unstale":"2024-04-25T13:17:45.623139+0000","last_undegraded":"2024-04-25T13:17:45.623139+0000","last_fullsized":"2024-04-25T13:17:45.623139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.623058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.623058+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.623058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:55.499137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.161470+0000","last_change":"2024-04-25T13:17:40.161496+0000","last_active":"2024-04-25T13:17:40.161470+0000","last_peered":"2024-04-25T13:17:40.161470+0000","last_clean":"2024-04-25T13:17:40.161470+0000","last_became_active":"2024-04-25T13:16:21.672065+0000","last_became_peered":"2024-04-25T13:16:21.672065+0000","last_unstale":"2024-04-25T13:17:40.161470+0000","last_undegraded":"2024-04-25T13:17:40.161470+0000","last_fullsized":"2024-04-25T13:17:40.161470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.161379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.161379+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.161379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:18.636256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.535717+0000","last_change":"2024-04-25T13:17:39.535763+0000","last_active":"2024-04-25T13:17:39.535717+0000","last_peered":"2024-04-25T13:17:39.535717+0000","last_clean":"2024-04-25T13:17:39.535717+0000","last_became_active":"2024-04-25T13:16:20.668271+0000","last_became_peered":"2024-04-25T13:16:20.668271+0000","last_unstale":"2024-04-25T13:17:39.535717+0000","last_undegraded":"2024-04-25T13:17:39.535717+0000","last_fullsized":"2024-04-25T13:17:39.535717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:39.535628+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:39.535628+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.535628+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:24.506577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.492983+0000","last_change":"2024-04-25T13:17:41.493015+0000","last_active":"2024-04-25T13:17:41.492983+0000","last_peered":"2024-04-25T13:17:41.492983+0000","last_clean":"2024-04-25T13:17:41.492983+0000","last_became_active":"2024-04-25T13:16:25.700831+0000","last_became_peered":"2024-04-25T13:16:25.700831+0000","last_unstale":"2024-04-25T13:17:41.492983+0000","last_undegraded":"2024-04-25T13:17:41.492983+0000","last_fullsized":"2024-04-25T13:17:41.492983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.492880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.492880+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.492880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:43:43.494252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.587822+0000","last_change":"2024-04-25T13:17:41.587847+0000","last_active":"2024-04-25T13:17:41.587822+0000","last_peered":"2024-04-25T13:17:41.587822+0000","last_clean":"2024-04-25T13:17:41.587822+0000","last_became_active":"2024-04-25T13:16:21.666596+0000","last_became_peered":"2024-04-25T13:16:21.666596+0000","last_unstale":"2024-04-25T13:17:41.587822+0000","last_undegraded":"2024-04-25T13:17:41.587822+0000","last_fullsized":"2024-04-25T13:17:41.587822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.587731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.587731+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.587731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:16.564123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.898022+0000","last_change":"2024-04-25T13:17:38.898057+0000","last_active":"2024-04-25T13:17:38.898022+0000","last_peered":"2024-04-25T13:17:38.898022+0000","last_clean":"2024-04-25T13:17:38.898022+0000","last_became_active":"2024-04-25T13:16:20.663463+0000","last_became_peered":"2024-04-25T13:16:20.663463+0000","last_unstale":"2024-04-25T13:17:38.898022+0000","last_undegraded":"2024-04-25T13:17:38.898022+0000","last_fullsized":"2024-04-25T13:17:38.898022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-04-25T13:17:38.897925+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-04-25T13:17:38.897925+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.897925+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:45.150153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.521022+0000","last_change":"2024-04-25T13:17:48.521050+0000","last_active":"2024-04-25T13:17:48.521022+0000","last_peered":"2024-04-25T13:17:48.521022+0000","last_clean":"2024-04-25T13:17:48.521022+0000","last_became_active":"2024-04-25T13:16:25.707393+0000","last_became_peered":"2024-04-25T13:16:25.707393+0000","last_unstale":"2024-04-25T13:17:48.521022+0000","last_undegraded":"2024-04-25T13:17:48.521022+0000","last_fullsized":"2024-04-25T13:17:48.521022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.520935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.520935+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.520935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:29.529745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.871504+0000","last_change":"2024-04-25T13:17:41.871533+0000","last_active":"2024-04-25T13:17:41.871504+0000","last_peered":"2024-04-25T13:17:41.871504+0000","last_clean":"2024-04-25T13:17:41.871504+0000","last_became_active":"2024-04-25T13:16:21.661721+0000","last_became_peered":"2024-04-25T13:16:21.661721+0000","last_unstale":"2024-04-25T13:17:41.871504+0000","last_undegraded":"2024-04-25T13:17:41.871504+0000","last_fullsized":"2024-04-25T13:17:41.871504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.871393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.871393+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.871393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:29:07.356594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.328583+0000","last_change":"2024-04-25T13:17:39.328617+0000","last_active":"2024-04-25T13:17:39.328583+0000","last_peered":"2024-04-25T13:17:39.328583+0000","last_clean":"2024-04-25T13:17:39.328583+0000","last_became_active":"2024-04-25T13:16:20.662121+0000","last_became_peered":"2024-04-25T13:16:20.662121+0000","last_unstale":"2024-04-25T13:17:39.328583+0000","last_undegraded":"2024-04-25T13:17:39.328583+0000","last_fullsized":"2024-04-25T13:17:39.328583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:39.328490+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:39.328490+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.328490+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:57:57.399978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.998351+0000","last_change":"2024-04-25T13:17:48.998380+0000","last_active":"2024-04-25T13:17:48.998351+0000","last_peered":"2024-04-25T13:17:48.998351+0000","last_clean":"2024-04-25T13:17:48.998351+0000","last_became_active":"2024-04-25T13:17:02.819016+0000","last_became_peered":"2024-04-25T13:17:02.819016+0000","last_unstale":"2024-04-25T13:17:48.998351+0000","last_undegraded":"2024-04-25T13:17:48.998351+0000","last_fullsized":"2024-04-25T13:17:48.998351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.998265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.998265+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.998265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:54.143488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.325661+0000","last_change":"2024-04-25T13:17:45.325683+0000","last_active":"2024-04-25T13:17:45.325661+0000","last_peered":"2024-04-25T13:17:45.325661+0000","last_clean":"2024-04-25T13:17:45.325661+0000","last_became_active":"2024-04-25T13:16:21.672220+0000","last_became_peered":"2024-04-25T13:16:21.672220+0000","last_unstale":"2024-04-25T13:17:45.325661+0000","last_undegraded":"2024-04-25T13:17:45.325661+0000","last_fullsized":"2024-04-25T13:17:45.325661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.325581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.325581+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.325581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:14.750564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.905345+0000","last_change":"2024-04-25T13:17:37.905389+0000","last_active":"2024-04-25T13:17:37.905345+0000","last_peered":"2024-04-25T13:17:37.905345+0000","last_clean":"2024-04-25T13:17:37.905345+0000","last_became_active":"2024-04-25T13:16:20.658102+0000","last_became_peered":"2024-04-25T13:16:20.658102+0000","last_unstale":"2024-04-25T13:17:37.905345+0000","last_undegraded":"2024-04-25T13:17:37.905345+0000","last_fullsized":"2024-04-25T13:17:37.905345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-04-25T13:17:37.905202+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-04-25T13:17:37.905202+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.905202+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:48.182149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.900803+0000","last_change":"2024-04-25T13:17:46.900835+0000","last_active":"2024-04-25T13:17:46.900803+0000","last_peered":"2024-04-25T13:17:46.900803+0000","last_clean":"2024-04-25T13:17:46.900803+0000","last_became_active":"2024-04-25T13:16:25.708260+0000","last_became_peered":"2024-04-25T13:16:25.708260+0000","last_unstale":"2024-04-25T13:17:46.900803+0000","last_undegraded":"2024-04-25T13:17:46.900803+0000","last_fullsized":"2024-04-25T13:17:46.900803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.900690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.900690+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.900690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:34.309331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.560036+0000","last_change":"2024-04-25T13:17:38.560058+0000","last_active":"2024-04-25T13:17:38.560036+0000","last_peered":"2024-04-25T13:17:38.560036+0000","last_clean":"2024-04-25T13:17:38.560036+0000","last_became_active":"2024-04-25T13:16:21.675152+0000","last_became_peered":"2024-04-25T13:16:21.675152+0000","last_unstale":"2024-04-25T13:17:38.560036+0000","last_undegraded":"2024-04-25T13:17:38.560036+0000","last_fullsized":"2024-04-25T13:17:38.560036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.559948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.559948+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.559948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:12:06.039454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.381565+0000","last_change":"2024-04-25T13:17:37.381623+0000","last_active":"2024-04-25T13:17:37.381565+0000","last_peered":"2024-04-25T13:17:37.381565+0000","last_clean":"2024-04-25T13:17:37.381565+0000","last_became_active":"2024-04-25T13:16:20.662040+0000","last_became_peered":"2024-04-25T13:16:20.662040+0000","last_unstale":"2024-04-25T13:17:37.381565+0000","last_undegraded":"2024-04-25T13:17:37.381565+0000","last_fullsized":"2024-04-25T13:17:37.381565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:37.381456+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:37.381456+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.381456+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:09:13.619626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:52.195121+0000","last_change":"2024-04-25T13:17:52.195152+0000","last_active":"2024-04-25T13:17:52.195121+0000","last_peered":"2024-04-25T13:17:52.195121+0000","last_clean":"2024-04-25T13:17:52.195121+0000","last_became_active":"2024-04-25T13:17:03.509216+0000","last_became_peered":"2024-04-25T13:17:03.509216+0000","last_unstale":"2024-04-25T13:17:52.195121+0000","last_undegraded":"2024-04-25T13:17:52.195121+0000","last_fullsized":"2024-04-25T13:17:52.195121+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:52.195016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:52.195016+0000","last_clean_scrub_stamp":"2024-04-25T13:17:52.195016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:52:14.983618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.886319+0000","last_change":"2024-04-25T13:17:40.886344+0000","last_active":"2024-04-25T13:17:40.886319+0000","last_peered":"2024-04-25T13:17:40.886319+0000","last_clean":"2024-04-25T13:17:40.886319+0000","last_became_active":"2024-04-25T13:16:21.659966+0000","last_became_peered":"2024-04-25T13:16:21.659966+0000","last_unstale":"2024-04-25T13:17:40.886319+0000","last_undegraded":"2024-04-25T13:17:40.886319+0000","last_fullsized":"2024-04-25T13:17:40.886319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.886231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.886231+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.886231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:22.934239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.742278+0000","last_change":"2024-04-25T13:17:34.742328+0000","last_active":"2024-04-25T13:17:34.742278+0000","last_peered":"2024-04-25T13:17:34.742278+0000","last_clean":"2024-04-25T13:17:34.742278+0000","last_became_active":"2024-04-25T13:16:20.659356+0000","last_became_peered":"2024-04-25T13:16:20.659356+0000","last_unstale":"2024-04-25T13:17:34.742278+0000","last_undegraded":"2024-04-25T13:17:34.742278+0000","last_fullsized":"2024-04-25T13:17:34.742278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:34.742194+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:34.742194+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.742194+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:17.103280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.862775+0000","last_change":"2024-04-25T13:17:47.862801+0000","last_active":"2024-04-25T13:17:47.862775+0000","last_peered":"2024-04-25T13:17:47.862775+0000","last_clean":"2024-04-25T13:17:47.862775+0000","last_became_active":"2024-04-25T13:16:25.712309+0000","last_became_peered":"2024-04-25T13:16:25.712309+0000","last_unstale":"2024-04-25T13:17:47.862775+0000","last_undegraded":"2024-04-25T13:17:47.862775+0000","last_fullsized":"2024-04-25T13:17:47.862775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.862668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.862668+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.862668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:37.157086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.079578+0000","last_change":"2024-04-25T13:17:42.079601+0000","last_active":"2024-04-25T13:17:42.079578+0000","last_peered":"2024-04-25T13:17:42.079578+0000","last_clean":"2024-04-25T13:17:42.079578+0000","last_became_active":"2024-04-25T13:16:21.676031+0000","last_became_peered":"2024-04-25T13:16:21.676031+0000","last_unstale":"2024-04-25T13:17:42.079578+0000","last_undegraded":"2024-04-25T13:17:42.079578+0000","last_fullsized":"2024-04-25T13:17:42.079578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.079486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.079486+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.079486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:00.774921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.359383+0000","last_change":"2024-04-25T13:17:42.359416+0000","last_active":"2024-04-25T13:17:42.359383+0000","last_peered":"2024-04-25T13:17:42.359383+0000","last_clean":"2024-04-25T13:17:42.359383+0000","last_became_active":"2024-04-25T13:16:20.662804+0000","last_became_peered":"2024-04-25T13:16:20.662804+0000","last_unstale":"2024-04-25T13:17:42.359383+0000","last_undegraded":"2024-04-25T13:17:42.359383+0000","last_fullsized":"2024-04-25T13:17:42.359383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T13:17:42.359299+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T13:17:42.359299+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.359299+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:31:19.941229+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.039596+0000","last_change":"2024-04-25T13:17:46.039628+0000","last_active":"2024-04-25T13:17:46.039596+0000","last_peered":"2024-04-25T13:17:46.039596+0000","last_clean":"2024-04-25T13:17:46.039596+0000","last_became_active":"2024-04-25T13:16:25.705696+0000","last_became_peered":"2024-04-25T13:16:25.705696+0000","last_unstale":"2024-04-25T13:17:46.039596+0000","last_undegraded":"2024-04-25T13:17:46.039596+0000","last_fullsized":"2024-04-25T13:17:46.039596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.039500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.039500+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.039500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:24.944566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.605943+0000","last_change":"2024-04-25T13:17:34.605961+0000","last_active":"2024-04-25T13:17:34.605943+0000","last_peered":"2024-04-25T13:17:34.605943+0000","last_clean":"2024-04-25T13:17:34.605943+0000","last_became_active":"2024-04-25T13:16:21.675639+0000","last_became_peered":"2024-04-25T13:16:21.675639+0000","last_unstale":"2024-04-25T13:17:34.605943+0000","last_undegraded":"2024-04-25T13:17:34.605943+0000","last_fullsized":"2024-04-25T13:17:34.605943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:34.605882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:34.605882+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.605882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:37.905341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.404045+0000","last_change":"2024-04-25T13:17:39.404087+0000","last_active":"2024-04-25T13:17:39.404045+0000","last_peered":"2024-04-25T13:17:39.404045+0000","last_clean":"2024-04-25T13:17:39.404045+0000","last_became_active":"2024-04-25T13:16:20.663569+0000","last_became_peered":"2024-04-25T13:16:20.663569+0000","last_unstale":"2024-04-25T13:17:39.404045+0000","last_undegraded":"2024-04-25T13:17:39.404045+0000","last_fullsized":"2024-04-25T13:17:39.404045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:39.403953+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:39.403953+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.403953+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:35.402815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.385051+0000","last_change":"2024-04-25T13:17:37.385083+0000","last_active":"2024-04-25T13:17:37.385051+0000","last_peered":"2024-04-25T13:17:37.385051+0000","last_clean":"2024-04-25T13:17:37.385051+0000","last_became_active":"2024-04-25T13:16:11.681050+0000","last_became_peered":"2024-04-25T13:16:11.681050+0000","last_unstale":"2024-04-25T13:17:37.385051+0000","last_undegraded":"2024-04-25T13:17:37.385051+0000","last_fullsized":"2024-04-25T13:17:37.385051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-25T13:17:37.384980+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-25T13:17:37.384980+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.384980+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:02:26.149387+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:49.444977+0000","last_change":"2024-04-25T13:17:49.445005+0000","last_active":"2024-04-25T13:17:49.444977+0000","last_peered":"2024-04-25T13:17:49.444977+0000","last_clean":"2024-04-25T13:17:49.444977+0000","last_became_active":"2024-04-25T13:16:25.717338+0000","last_became_peered":"2024-04-25T13:16:25.717338+0000","last_unstale":"2024-04-25T13:17:49.444977+0000","last_undegraded":"2024-04-25T13:17:49.444977+0000","last_fullsized":"2024-04-25T13:17:49.444977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:49.444878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:49.444878+0000","last_clean_scrub_stamp":"2024-04-25T13:17:49.444878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:51.756866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.356088+0000","last_change":"2024-04-25T13:17:44.356112+0000","last_active":"2024-04-25T13:17:44.356088+0000","last_peered":"2024-04-25T13:17:44.356088+0000","last_clean":"2024-04-25T13:17:44.356088+0000","last_became_active":"2024-04-25T13:16:21.667185+0000","last_became_peered":"2024-04-25T13:16:21.667185+0000","last_unstale":"2024-04-25T13:17:44.356088+0000","last_undegraded":"2024-04-25T13:17:44.356088+0000","last_fullsized":"2024-04-25T13:17:44.356088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.356000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.356000+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.356000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:05:20.224924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.761673+0000","last_change":"2024-04-25T13:17:36.761701+0000","last_active":"2024-04-25T13:17:36.761673+0000","last_peered":"2024-04-25T13:17:36.761673+0000","last_clean":"2024-04-25T13:17:36.761673+0000","last_became_active":"2024-04-25T13:16:20.664428+0000","last_became_peered":"2024-04-25T13:16:20.664428+0000","last_unstale":"2024-04-25T13:17:36.761673+0000","last_undegraded":"2024-04-25T13:17:36.761673+0000","last_fullsized":"2024-04-25T13:17:36.761673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:36.761605+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:36.761605+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.761605+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:37.095711+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.477315+0000","last_change":"2024-04-25T13:17:48.477342+0000","last_active":"2024-04-25T13:17:48.477315+0000","last_peered":"2024-04-25T13:17:48.477315+0000","last_clean":"2024-04-25T13:17:48.477315+0000","last_became_active":"2024-04-25T13:16:25.704373+0000","last_became_peered":"2024-04-25T13:16:25.704373+0000","last_unstale":"2024-04-25T13:17:48.477315+0000","last_undegraded":"2024-04-25T13:17:48.477315+0000","last_fullsized":"2024-04-25T13:17:48.477315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.477236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.477236+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.477236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:07.408549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.371936+0000","last_change":"2024-04-25T13:17:43.371993+0000","last_active":"2024-04-25T13:17:43.371936+0000","last_peered":"2024-04-25T13:17:43.371936+0000","last_clean":"2024-04-25T13:17:43.371936+0000","last_became_active":"2024-04-25T13:16:21.667699+0000","last_became_peered":"2024-04-25T13:16:21.667699+0000","last_unstale":"2024-04-25T13:17:43.371936+0000","last_undegraded":"2024-04-25T13:17:43.371936+0000","last_fullsized":"2024-04-25T13:17:43.371936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.371813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.371813+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.371813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:24:21.787375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.870516+0000","last_change":"2024-04-25T13:17:36.870572+0000","last_active":"2024-04-25T13:17:36.870516+0000","last_peered":"2024-04-25T13:17:36.870516+0000","last_clean":"2024-04-25T13:17:36.870516+0000","last_became_active":"2024-04-25T13:16:20.657490+0000","last_became_peered":"2024-04-25T13:16:20.657490+0000","last_unstale":"2024-04-25T13:17:36.870516+0000","last_undegraded":"2024-04-25T13:17:36.870516+0000","last_fullsized":"2024-04-25T13:17:36.870516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:36.870432+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:36.870432+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.870432+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:01:55.558792+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.044823+0000","last_change":"2024-04-25T13:17:45.044849+0000","last_active":"2024-04-25T13:17:45.044823+0000","last_peered":"2024-04-25T13:17:45.044823+0000","last_clean":"2024-04-25T13:17:45.044823+0000","last_became_active":"2024-04-25T13:16:25.701528+0000","last_became_peered":"2024-04-25T13:16:25.701528+0000","last_unstale":"2024-04-25T13:17:45.044823+0000","last_undegraded":"2024-04-25T13:17:45.044823+0000","last_fullsized":"2024-04-25T13:17:45.044823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.044717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.044717+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.044717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:50.965586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:51.354521+0000","last_change":"2024-04-25T13:17:51.354546+0000","last_active":"2024-04-25T13:17:51.354521+0000","last_peered":"2024-04-25T13:17:51.354521+0000","last_clean":"2024-04-25T13:17:51.354521+0000","last_became_active":"2024-04-25T13:16:21.678415+0000","last_became_peered":"2024-04-25T13:16:21.678415+0000","last_unstale":"2024-04-25T13:17:51.354521+0000","last_undegraded":"2024-04-25T13:17:51.354521+0000","last_fullsized":"2024-04-25T13:17:51.354521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:51.354439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:51.354439+0000","last_clean_scrub_stamp":"2024-04-25T13:17:51.354439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:10:25.108413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.784278+0000","last_change":"2024-04-25T13:17:33.784322+0000","last_active":"2024-04-25T13:17:33.784278+0000","last_peered":"2024-04-25T13:17:33.784278+0000","last_clean":"2024-04-25T13:17:33.784278+0000","last_became_active":"2024-04-25T13:16:20.659180+0000","last_became_peered":"2024-04-25T13:16:20.659180+0000","last_unstale":"2024-04-25T13:17:33.784278+0000","last_undegraded":"2024-04-25T13:17:33.784278+0000","last_fullsized":"2024-04-25T13:17:33.784278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:33.784182+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:33.784182+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.784182+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:04:11.967464+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:50.249827+0000","last_change":"2024-04-25T13:17:50.249851+0000","last_active":"2024-04-25T13:17:50.249827+0000","last_peered":"2024-04-25T13:17:50.249827+0000","last_clean":"2024-04-25T13:17:50.249827+0000","last_became_active":"2024-04-25T13:16:25.703640+0000","last_became_peered":"2024-04-25T13:16:25.703640+0000","last_unstale":"2024-04-25T13:17:50.249827+0000","last_undegraded":"2024-04-25T13:17:50.249827+0000","last_fullsized":"2024-04-25T13:17:50.249827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:50.249735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:50.249735+0000","last_clean_scrub_stamp":"2024-04-25T13:17:50.249735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:59.163042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:49.409701+0000","last_change":"2024-04-25T13:17:49.409726+0000","last_active":"2024-04-25T13:17:49.409701+0000","last_peered":"2024-04-25T13:17:49.409701+0000","last_clean":"2024-04-25T13:17:49.409701+0000","last_became_active":"2024-04-25T13:16:21.677618+0000","last_became_peered":"2024-04-25T13:16:21.677618+0000","last_unstale":"2024-04-25T13:17:49.409701+0000","last_undegraded":"2024-04-25T13:17:49.409701+0000","last_fullsized":"2024-04-25T13:17:49.409701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:49.409621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:49.409621+0000","last_clean_scrub_stamp":"2024-04-25T13:17:49.409621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:19:27.899325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:34.609537+0000","last_change":"2024-04-25T13:17:34.609568+0000","last_active":"2024-04-25T13:17:34.609537+0000","last_peered":"2024-04-25T13:17:34.609537+0000","last_clean":"2024-04-25T13:17:34.609537+0000","last_became_active":"2024-04-25T13:16:20.662021+0000","last_became_peered":"2024-04-25T13:16:20.662021+0000","last_unstale":"2024-04-25T13:17:34.609537+0000","last_undegraded":"2024-04-25T13:17:34.609537+0000","last_fullsized":"2024-04-25T13:17:34.609537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T13:17:34.609455+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T13:17:34.609455+0000","last_clean_scrub_stamp":"2024-04-25T13:17:34.609455+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:19.981784+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.627980+0000","last_change":"2024-04-25T13:17:47.628010+0000","last_active":"2024-04-25T13:17:47.627980+0000","last_peered":"2024-04-25T13:17:47.627980+0000","last_clean":"2024-04-25T13:17:47.627980+0000","last_became_active":"2024-04-25T13:16:25.711516+0000","last_became_peered":"2024-04-25T13:16:25.711516+0000","last_unstale":"2024-04-25T13:17:47.627980+0000","last_undegraded":"2024-04-25T13:17:47.627980+0000","last_fullsized":"2024-04-25T13:17:47.627980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.627886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.627886+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.627886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:20.613704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:52.346725+0000","last_change":"2024-04-25T13:17:52.346748+0000","last_active":"2024-04-25T13:17:52.346725+0000","last_peered":"2024-04-25T13:17:52.346725+0000","last_clean":"2024-04-25T13:17:52.346725+0000","last_became_active":"2024-04-25T13:16:21.678736+0000","last_became_peered":"2024-04-25T13:16:21.678736+0000","last_unstale":"2024-04-25T13:17:52.346725+0000","last_undegraded":"2024-04-25T13:17:52.346725+0000","last_fullsized":"2024-04-25T13:17:52.346725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:52.346645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:52.346645+0000","last_clean_scrub_stamp":"2024-04-25T13:17:52.346645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:11.886635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.788945+0000","last_change":"2024-04-25T13:17:35.789004+0000","last_active":"2024-04-25T13:17:35.788945+0000","last_peered":"2024-04-25T13:17:35.788945+0000","last_clean":"2024-04-25T13:17:35.788945+0000","last_became_active":"2024-04-25T13:16:20.661914+0000","last_became_peered":"2024-04-25T13:16:20.661914+0000","last_unstale":"2024-04-25T13:17:35.788945+0000","last_undegraded":"2024-04-25T13:17:35.788945+0000","last_fullsized":"2024-04-25T13:17:35.788945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-04-25T13:17:35.788830+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-04-25T13:17:35.788830+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.788830+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:49:40.718335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.034199+0000","last_change":"2024-04-25T13:17:48.034263+0000","last_active":"2024-04-25T13:17:48.034199+0000","last_peered":"2024-04-25T13:17:48.034199+0000","last_clean":"2024-04-25T13:17:48.034199+0000","last_became_active":"2024-04-25T13:16:25.711515+0000","last_became_peered":"2024-04-25T13:16:25.711515+0000","last_unstale":"2024-04-25T13:17:48.034199+0000","last_undegraded":"2024-04-25T13:17:48.034199+0000","last_fullsized":"2024-04-25T13:17:48.034199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.034097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.034097+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.034097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:04.249976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.486439+0000","last_change":"2024-04-25T13:17:40.486476+0000","last_active":"2024-04-25T13:17:40.486439+0000","last_peered":"2024-04-25T13:17:40.486439+0000","last_clean":"2024-04-25T13:17:40.486439+0000","last_became_active":"2024-04-25T13:16:21.675320+0000","last_became_peered":"2024-04-25T13:16:21.675320+0000","last_unstale":"2024-04-25T13:17:40.486439+0000","last_undegraded":"2024-04-25T13:17:40.486439+0000","last_fullsized":"2024-04-25T13:17:40.486439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.486304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.486304+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.486304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:09.346798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.526774+0000","last_change":"2024-04-25T13:17:38.526810+0000","last_active":"2024-04-25T13:17:38.526774+0000","last_peered":"2024-04-25T13:17:38.526774+0000","last_clean":"2024-04-25T13:17:38.526774+0000","last_became_active":"2024-04-25T13:16:20.666981+0000","last_became_peered":"2024-04-25T13:16:20.666981+0000","last_unstale":"2024-04-25T13:17:38.526774+0000","last_undegraded":"2024-04-25T13:17:38.526774+0000","last_fullsized":"2024-04-25T13:17:38.526774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:38.526684+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:38.526684+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.526684+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:19.858028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:51.569886+0000","last_change":"2024-04-25T13:17:51.569930+0000","last_active":"2024-04-25T13:17:51.569886+0000","last_peered":"2024-04-25T13:17:51.569886+0000","last_clean":"2024-04-25T13:17:51.569886+0000","last_became_active":"2024-04-25T13:16:25.715221+0000","last_became_peered":"2024-04-25T13:16:25.715221+0000","last_unstale":"2024-04-25T13:17:51.569886+0000","last_undegraded":"2024-04-25T13:17:51.569886+0000","last_fullsized":"2024-04-25T13:17:51.569886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:51.569771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:51.569771+0000","last_clean_scrub_stamp":"2024-04-25T13:17:51.569771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:20.561311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:50.392152+0000","last_change":"2024-04-25T13:17:50.392178+0000","last_active":"2024-04-25T13:17:50.392152+0000","last_peered":"2024-04-25T13:17:50.392152+0000","last_clean":"2024-04-25T13:17:50.392152+0000","last_became_active":"2024-04-25T13:16:21.677702+0000","last_became_peered":"2024-04-25T13:16:21.677702+0000","last_unstale":"2024-04-25T13:17:50.392152+0000","last_undegraded":"2024-04-25T13:17:50.392152+0000","last_fullsized":"2024-04-25T13:17:50.392152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:50.392073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:50.392073+0000","last_clean_scrub_stamp":"2024-04-25T13:17:50.392073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:10.441927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.393979+0000","last_change":"2024-04-25T13:17:40.394016+0000","last_active":"2024-04-25T13:17:40.393979+0000","last_peered":"2024-04-25T13:17:40.393979+0000","last_clean":"2024-04-25T13:17:40.393979+0000","last_became_active":"2024-04-25T13:16:20.666150+0000","last_became_peered":"2024-04-25T13:16:20.666150+0000","last_unstale":"2024-04-25T13:17:40.393979+0000","last_undegraded":"2024-04-25T13:17:40.393979+0000","last_fullsized":"2024-04-25T13:17:40.393979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:40.393878+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:40.393878+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.393878+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:15.402977+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:53.547315+0000","last_change":"2024-04-25T13:17:53.547355+0000","last_active":"2024-04-25T13:17:53.547315+0000","last_peered":"2024-04-25T13:17:53.547315+0000","last_clean":"2024-04-25T13:17:53.547315+0000","last_became_active":"2024-04-25T13:17:02.817864+0000","last_became_peered":"2024-04-25T13:17:02.817864+0000","last_unstale":"2024-04-25T13:17:53.547315+0000","last_undegraded":"2024-04-25T13:17:53.547315+0000","last_fullsized":"2024-04-25T13:17:53.547315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:53.547198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:53.547198+0000","last_clean_scrub_stamp":"2024-04-25T13:17:53.547198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:13.597052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.150493+0000","last_change":"2024-04-25T13:17:36.150515+0000","last_active":"2024-04-25T13:17:36.150493+0000","last_peered":"2024-04-25T13:17:36.150493+0000","last_clean":"2024-04-25T13:17:36.150493+0000","last_became_active":"2024-04-25T13:16:21.669441+0000","last_became_peered":"2024-04-25T13:16:21.669441+0000","last_unstale":"2024-04-25T13:17:36.150493+0000","last_undegraded":"2024-04-25T13:17:36.150493+0000","last_fullsized":"2024-04-25T13:17:36.150493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.150420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.150420+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.150420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:54.318076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'14","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.157063+0000","last_change":"2024-04-25T13:17:35.157097+0000","last_active":"2024-04-25T13:17:35.157063+0000","last_peered":"2024-04-25T13:17:35.157063+0000","last_clean":"2024-04-25T13:17:35.157063+0000","last_became_active":"2024-04-25T13:16:20.662802+0000","last_became_peered":"2024-04-25T13:16:20.662802+0000","last_unstale":"2024-04-25T13:17:35.157063+0000","last_undegraded":"2024-04-25T13:17:35.157063+0000","last_fullsized":"2024-04-25T13:17:35.157063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-25T13:17:35.156999+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-25T13:17:35.156999+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.156999+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:50:35.135147+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:51.229643+0000","last_change":"2024-04-25T13:17:51.229670+0000","last_active":"2024-04-25T13:17:51.229643+0000","last_peered":"2024-04-25T13:17:51.229643+0000","last_clean":"2024-04-25T13:17:51.229643+0000","last_became_active":"2024-04-25T13:16:25.708157+0000","last_became_peered":"2024-04-25T13:16:25.708157+0000","last_unstale":"2024-04-25T13:17:51.229643+0000","last_undegraded":"2024-04-25T13:17:51.229643+0000","last_fullsized":"2024-04-25T13:17:51.229643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:51.229515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:51.229515+0000","last_clean_scrub_stamp":"2024-04-25T13:17:51.229515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:53.358102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.410684+0000","last_change":"2024-04-25T13:17:47.410707+0000","last_active":"2024-04-25T13:17:47.410684+0000","last_peered":"2024-04-25T13:17:47.410684+0000","last_clean":"2024-04-25T13:17:47.410684+0000","last_became_active":"2024-04-25T13:16:21.670928+0000","last_became_peered":"2024-04-25T13:16:21.670928+0000","last_unstale":"2024-04-25T13:17:47.410684+0000","last_undegraded":"2024-04-25T13:17:47.410684+0000","last_fullsized":"2024-04-25T13:17:47.410684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.410603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.410603+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.410603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:55:24.037314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'19","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.533634+0000","last_change":"2024-04-25T13:17:36.533671+0000","last_active":"2024-04-25T13:17:36.533634+0000","last_peered":"2024-04-25T13:17:36.533634+0000","last_clean":"2024-04-25T13:17:36.533634+0000","last_became_active":"2024-04-25T13:16:20.665839+0000","last_became_peered":"2024-04-25T13:16:20.665839+0000","last_unstale":"2024-04-25T13:17:36.533634+0000","last_undegraded":"2024-04-25T13:17:36.533634+0000","last_fullsized":"2024-04-25T13:17:36.533634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-04-25T13:17:36.533557+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-04-25T13:17:36.533557+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.533557+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:57.312936+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.885780+0000","last_change":"2024-04-25T13:17:45.885810+0000","last_active":"2024-04-25T13:17:45.885780+0000","last_peered":"2024-04-25T13:17:45.885780+0000","last_clean":"2024-04-25T13:17:45.885780+0000","last_became_active":"2024-04-25T13:16:25.707678+0000","last_became_peered":"2024-04-25T13:16:25.707678+0000","last_unstale":"2024-04-25T13:17:45.885780+0000","last_undegraded":"2024-04-25T13:17:45.885780+0000","last_fullsized":"2024-04-25T13:17:45.885780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.885675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.885675+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.885675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:35:24.227728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.559049+0000","last_change":"2024-04-25T13:17:36.559074+0000","last_active":"2024-04-25T13:17:36.559049+0000","last_peered":"2024-04-25T13:17:36.559049+0000","last_clean":"2024-04-25T13:17:36.559049+0000","last_became_active":"2024-04-25T13:16:21.669867+0000","last_became_peered":"2024-04-25T13:16:21.669867+0000","last_unstale":"2024-04-25T13:17:36.559049+0000","last_undegraded":"2024-04-25T13:17:36.559049+0000","last_fullsized":"2024-04-25T13:17:36.559049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.558946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.558946+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.558946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:53.284718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.862712+0000","last_change":"2024-04-25T13:17:39.862757+0000","last_active":"2024-04-25T13:17:39.862712+0000","last_peered":"2024-04-25T13:17:39.862712+0000","last_clean":"2024-04-25T13:17:39.862712+0000","last_became_active":"2024-04-25T13:16:20.663577+0000","last_became_peered":"2024-04-25T13:16:20.663577+0000","last_unstale":"2024-04-25T13:17:39.862712+0000","last_undegraded":"2024-04-25T13:17:39.862712+0000","last_fullsized":"2024-04-25T13:17:39.862712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-04-25T13:17:39.862635+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-04-25T13:17:39.862635+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.862635+0000","objects_scrubbed":4,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:58.622464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.565820+0000","last_change":"2024-04-25T13:17:43.565860+0000","last_active":"2024-04-25T13:17:43.565820+0000","last_peered":"2024-04-25T13:17:43.565820+0000","last_clean":"2024-04-25T13:17:43.565820+0000","last_became_active":"2024-04-25T13:16:25.703113+0000","last_became_peered":"2024-04-25T13:16:25.703113+0000","last_unstale":"2024-04-25T13:17:43.565820+0000","last_undegraded":"2024-04-25T13:17:43.565820+0000","last_fullsized":"2024-04-25T13:17:43.565820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.565707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.565707+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.565707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:11.315660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.040270+0000","last_change":"2024-04-25T13:17:44.040307+0000","last_active":"2024-04-25T13:17:44.040270+0000","last_peered":"2024-04-25T13:17:44.040270+0000","last_clean":"2024-04-25T13:17:44.040270+0000","last_became_active":"2024-04-25T13:16:21.680678+0000","last_became_peered":"2024-04-25T13:16:21.680678+0000","last_unstale":"2024-04-25T13:17:44.040270+0000","last_undegraded":"2024-04-25T13:17:44.040270+0000","last_fullsized":"2024-04-25T13:17:44.040270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.040178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.040178+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.040178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:06.866269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.420211+0000","last_change":"2024-04-25T13:17:41.420242+0000","last_active":"2024-04-25T13:17:41.420211+0000","last_peered":"2024-04-25T13:17:41.420211+0000","last_clean":"2024-04-25T13:17:41.420211+0000","last_became_active":"2024-04-25T13:16:20.668198+0000","last_became_peered":"2024-04-25T13:16:20.668198+0000","last_unstale":"2024-04-25T13:17:41.420211+0000","last_undegraded":"2024-04-25T13:17:41.420211+0000","last_fullsized":"2024-04-25T13:17:41.420211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T13:17:41.420114+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T13:17:41.420114+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.420114+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:37.953520+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.537098+0000","last_change":"2024-04-25T13:17:47.537143+0000","last_active":"2024-04-25T13:17:47.537098+0000","last_peered":"2024-04-25T13:17:47.537098+0000","last_clean":"2024-04-25T13:17:47.537098+0000","last_became_active":"2024-04-25T13:16:25.706858+0000","last_became_peered":"2024-04-25T13:16:25.706858+0000","last_unstale":"2024-04-25T13:17:47.537098+0000","last_undegraded":"2024-04-25T13:17:47.537098+0000","last_fullsized":"2024-04-25T13:17:47.537098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.536999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.536999+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.536999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:54.264460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.701927+0000","last_change":"2024-04-25T13:17:40.701949+0000","last_active":"2024-04-25T13:17:40.701927+0000","last_peered":"2024-04-25T13:17:40.701927+0000","last_clean":"2024-04-25T13:17:40.701927+0000","last_became_active":"2024-04-25T13:17:02.817270+0000","last_became_peered":"2024-04-25T13:17:02.817270+0000","last_unstale":"2024-04-25T13:17:40.701927+0000","last_undegraded":"2024-04-25T13:17:40.701927+0000","last_fullsized":"2024-04-25T13:17:40.701927+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:40.701842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:40.701842+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.701842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:42.712164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.488260+0000","last_change":"2024-04-25T13:17:35.488292+0000","last_active":"2024-04-25T13:17:35.488260+0000","last_peered":"2024-04-25T13:17:35.488260+0000","last_clean":"2024-04-25T13:17:35.488260+0000","last_became_active":"2024-04-25T13:16:20.664501+0000","last_became_peered":"2024-04-25T13:16:20.664501+0000","last_unstale":"2024-04-25T13:17:35.488260+0000","last_undegraded":"2024-04-25T13:17:35.488260+0000","last_fullsized":"2024-04-25T13:17:35.488260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-04-25T13:17:35.488175+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-04-25T13:17:35.488175+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.488175+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:51.101568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:52.573002+0000","last_change":"2024-04-25T13:17:52.573030+0000","last_active":"2024-04-25T13:17:52.573002+0000","last_peered":"2024-04-25T13:17:52.573002+0000","last_clean":"2024-04-25T13:17:52.573002+0000","last_became_active":"2024-04-25T13:16:25.715411+0000","last_became_peered":"2024-04-25T13:16:25.715411+0000","last_unstale":"2024-04-25T13:17:52.573002+0000","last_undegraded":"2024-04-25T13:17:52.573002+0000","last_fullsized":"2024-04-25T13:17:52.573002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:52.572917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:52.572917+0000","last_clean_scrub_stamp":"2024-04-25T13:17:52.572917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:52.871560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.021499+0000","last_change":"2024-04-25T13:17:47.021553+0000","last_active":"2024-04-25T13:17:47.021499+0000","last_peered":"2024-04-25T13:17:47.021499+0000","last_clean":"2024-04-25T13:17:47.021499+0000","last_became_active":"2024-04-25T13:16:25.710819+0000","last_became_peered":"2024-04-25T13:16:25.710819+0000","last_unstale":"2024-04-25T13:17:47.021499+0000","last_undegraded":"2024-04-25T13:17:47.021499+0000","last_fullsized":"2024-04-25T13:17:47.021499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.021389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.021389+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.021389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:27:16.307667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.894675+0000","last_change":"2024-04-25T13:17:43.894703+0000","last_active":"2024-04-25T13:17:43.894675+0000","last_peered":"2024-04-25T13:17:43.894675+0000","last_clean":"2024-04-25T13:17:43.894675+0000","last_became_active":"2024-04-25T13:16:21.668148+0000","last_became_peered":"2024-04-25T13:16:21.668148+0000","last_unstale":"2024-04-25T13:17:43.894675+0000","last_undegraded":"2024-04-25T13:17:43.894675+0000","last_fullsized":"2024-04-25T13:17:43.894675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.894585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.894585+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.894585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:17.938227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.420231+0000","last_change":"2024-04-25T13:17:38.420258+0000","last_active":"2024-04-25T13:17:38.420231+0000","last_peered":"2024-04-25T13:17:38.420231+0000","last_clean":"2024-04-25T13:17:38.420231+0000","last_became_active":"2024-04-25T13:16:20.663498+0000","last_became_peered":"2024-04-25T13:16:20.663498+0000","last_unstale":"2024-04-25T13:17:38.420231+0000","last_undegraded":"2024-04-25T13:17:38.420231+0000","last_fullsized":"2024-04-25T13:17:38.420231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:38.420148+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:38.420148+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.420148+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:11.406312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.450357+0000","last_change":"2024-04-25T13:17:47.450382+0000","last_active":"2024-04-25T13:17:47.450357+0000","last_peered":"2024-04-25T13:17:47.450357+0000","last_clean":"2024-04-25T13:17:47.450357+0000","last_became_active":"2024-04-25T13:16:25.703536+0000","last_became_peered":"2024-04-25T13:16:25.703536+0000","last_unstale":"2024-04-25T13:17:47.450357+0000","last_undegraded":"2024-04-25T13:17:47.450357+0000","last_fullsized":"2024-04-25T13:17:47.450357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.450274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.450274+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.450274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:59.254702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.523429+0000","last_change":"2024-04-25T13:17:43.523452+0000","last_active":"2024-04-25T13:17:43.523429+0000","last_peered":"2024-04-25T13:17:43.523429+0000","last_clean":"2024-04-25T13:17:43.523429+0000","last_became_active":"2024-04-25T13:16:21.667603+0000","last_became_peered":"2024-04-25T13:16:21.667603+0000","last_unstale":"2024-04-25T13:17:43.523429+0000","last_undegraded":"2024-04-25T13:17:43.523429+0000","last_fullsized":"2024-04-25T13:17:43.523429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.523346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.523346+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.523346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:52.436653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:40.624762+0000","last_change":"2024-04-25T13:17:40.624809+0000","last_active":"2024-04-25T13:17:40.624762+0000","last_peered":"2024-04-25T13:17:40.624762+0000","last_clean":"2024-04-25T13:17:40.624762+0000","last_became_active":"2024-04-25T13:16:20.662845+0000","last_became_peered":"2024-04-25T13:16:20.662845+0000","last_unstale":"2024-04-25T13:17:40.624762+0000","last_undegraded":"2024-04-25T13:17:40.624762+0000","last_fullsized":"2024-04-25T13:17:40.624762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T13:17:40.624650+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T13:17:40.624650+0000","last_clean_scrub_stamp":"2024-04-25T13:17:40.624650+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:29.943315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.535862+0000","last_change":"2024-04-25T13:17:37.535899+0000","last_active":"2024-04-25T13:17:37.535862+0000","last_peered":"2024-04-25T13:17:37.535862+0000","last_clean":"2024-04-25T13:17:37.535862+0000","last_became_active":"2024-04-25T13:16:20.666280+0000","last_became_peered":"2024-04-25T13:16:20.666280+0000","last_unstale":"2024-04-25T13:17:37.535862+0000","last_undegraded":"2024-04-25T13:17:37.535862+0000","last_fullsized":"2024-04-25T13:17:37.535862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-04-25T13:17:37.535752+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-04-25T13:17:37.535752+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.535752+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:58.926093+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.208826+0000","last_change":"2024-04-25T13:17:33.208860+0000","last_active":"2024-04-25T13:17:33.208826+0000","last_peered":"2024-04-25T13:17:33.208826+0000","last_clean":"2024-04-25T13:17:33.208826+0000","last_became_active":"2024-04-25T13:16:21.676081+0000","last_became_peered":"2024-04-25T13:16:21.676081+0000","last_unstale":"2024-04-25T13:17:33.208826+0000","last_undegraded":"2024-04-25T13:17:33.208826+0000","last_fullsized":"2024-04-25T13:17:33.208826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.208729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.208729+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.208729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:26.219325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.745779+0000","last_change":"2024-04-25T13:17:39.745808+0000","last_active":"2024-04-25T13:17:39.745779+0000","last_peered":"2024-04-25T13:17:39.745779+0000","last_clean":"2024-04-25T13:17:39.745779+0000","last_became_active":"2024-04-25T13:16:25.711547+0000","last_became_peered":"2024-04-25T13:16:25.711547+0000","last_unstale":"2024-04-25T13:17:39.745779+0000","last_undegraded":"2024-04-25T13:17:39.745779+0000","last_fullsized":"2024-04-25T13:17:39.745779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.745676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.745676+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.745676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:57.463489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.620416+0000","last_change":"2024-04-25T13:17:38.620445+0000","last_active":"2024-04-25T13:17:38.620416+0000","last_peered":"2024-04-25T13:17:38.620416+0000","last_clean":"2024-04-25T13:17:38.620416+0000","last_became_active":"2024-04-25T13:16:20.658109+0000","last_became_peered":"2024-04-25T13:16:20.658109+0000","last_unstale":"2024-04-25T13:17:38.620416+0000","last_undegraded":"2024-04-25T13:17:38.620416+0000","last_fullsized":"2024-04-25T13:17:38.620416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-04-25T13:17:38.620335+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-04-25T13:17:38.620335+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.620335+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:18.484812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.600690+0000","last_change":"2024-04-25T13:17:37.600730+0000","last_active":"2024-04-25T13:17:37.600690+0000","last_peered":"2024-04-25T13:17:37.600690+0000","last_clean":"2024-04-25T13:17:37.600690+0000","last_became_active":"2024-04-25T13:16:21.674510+0000","last_became_peered":"2024-04-25T13:16:21.674510+0000","last_unstale":"2024-04-25T13:17:37.600690+0000","last_undegraded":"2024-04-25T13:17:37.600690+0000","last_fullsized":"2024-04-25T13:17:37.600690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.600571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.600571+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.600571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:15.050097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:50.556965+0000","last_change":"2024-04-25T13:17:50.556989+0000","last_active":"2024-04-25T13:17:50.556965+0000","last_peered":"2024-04-25T13:17:50.556965+0000","last_clean":"2024-04-25T13:17:50.556965+0000","last_became_active":"2024-04-25T13:16:25.715207+0000","last_became_peered":"2024-04-25T13:16:25.715207+0000","last_unstale":"2024-04-25T13:17:50.556965+0000","last_undegraded":"2024-04-25T13:17:50.556965+0000","last_fullsized":"2024-04-25T13:17:50.556965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:50.556879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:50.556879+0000","last_clean_scrub_stamp":"2024-04-25T13:17:50.556879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:36.043177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.480332+0000","last_change":"2024-04-25T13:17:41.480353+0000","last_active":"2024-04-25T13:17:41.480332+0000","last_peered":"2024-04-25T13:17:41.480332+0000","last_clean":"2024-04-25T13:17:41.480332+0000","last_became_active":"2024-04-25T13:16:21.678210+0000","last_became_peered":"2024-04-25T13:16:21.678210+0000","last_unstale":"2024-04-25T13:17:41.480332+0000","last_undegraded":"2024-04-25T13:17:41.480332+0000","last_fullsized":"2024-04-25T13:17:41.480332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.480255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.480255+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.480255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:43.752270+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.744954+0000","last_change":"2024-04-25T13:17:37.745005+0000","last_active":"2024-04-25T13:17:37.744954+0000","last_peered":"2024-04-25T13:17:37.744954+0000","last_clean":"2024-04-25T13:17:37.744954+0000","last_became_active":"2024-04-25T13:16:21.668144+0000","last_became_peered":"2024-04-25T13:16:21.668144+0000","last_unstale":"2024-04-25T13:17:37.744954+0000","last_undegraded":"2024-04-25T13:17:37.744954+0000","last_fullsized":"2024-04-25T13:17:37.744954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.744850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.744850+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.744850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:24:39.680392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.333193+0000","last_change":"2024-04-25T13:17:44.333218+0000","last_active":"2024-04-25T13:17:44.333193+0000","last_peered":"2024-04-25T13:17:44.333193+0000","last_clean":"2024-04-25T13:17:44.333193+0000","last_became_active":"2024-04-25T13:16:21.668271+0000","last_became_peered":"2024-04-25T13:16:21.668271+0000","last_unstale":"2024-04-25T13:17:44.333193+0000","last_undegraded":"2024-04-25T13:17:44.333193+0000","last_fullsized":"2024-04-25T13:17:44.333193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.333108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.333108+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.333108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:58.982098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.123243+0000","last_change":"2024-04-25T13:17:41.123264+0000","last_active":"2024-04-25T13:17:41.123243+0000","last_peered":"2024-04-25T13:17:41.123243+0000","last_clean":"2024-04-25T13:17:41.123243+0000","last_became_active":"2024-04-25T13:16:21.672860+0000","last_became_peered":"2024-04-25T13:16:21.672860+0000","last_unstale":"2024-04-25T13:17:41.123243+0000","last_undegraded":"2024-04-25T13:17:41.123243+0000","last_fullsized":"2024-04-25T13:17:41.123243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.123138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.123138+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.123138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:52.362798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.570019+0000","last_change":"2024-04-25T13:17:37.570079+0000","last_active":"2024-04-25T13:17:37.570019+0000","last_peered":"2024-04-25T13:17:37.570019+0000","last_clean":"2024-04-25T13:17:37.570019+0000","last_became_active":"2024-04-25T13:16:21.674525+0000","last_became_peered":"2024-04-25T13:16:21.674525+0000","last_unstale":"2024-04-25T13:17:37.570019+0000","last_undegraded":"2024-04-25T13:17:37.570019+0000","last_fullsized":"2024-04-25T13:17:37.570019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.569916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.569916+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.569916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:58.044858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:33.858507+0000","last_change":"2024-04-25T13:17:33.858542+0000","last_active":"2024-04-25T13:17:33.858507+0000","last_peered":"2024-04-25T13:17:33.858507+0000","last_clean":"2024-04-25T13:17:33.858507+0000","last_became_active":"2024-04-25T13:16:21.667284+0000","last_became_peered":"2024-04-25T13:16:21.667284+0000","last_unstale":"2024-04-25T13:17:33.858507+0000","last_undegraded":"2024-04-25T13:17:33.858507+0000","last_fullsized":"2024-04-25T13:17:33.858507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:33.858433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:33.858433+0000","last_clean_scrub_stamp":"2024-04-25T13:17:33.858433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:02.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.447149+0000","last_change":"2024-04-25T13:17:42.447186+0000","last_active":"2024-04-25T13:17:42.447149+0000","last_peered":"2024-04-25T13:17:42.447149+0000","last_clean":"2024-04-25T13:17:42.447149+0000","last_became_active":"2024-04-25T13:16:21.679179+0000","last_became_peered":"2024-04-25T13:16:21.679179+0000","last_unstale":"2024-04-25T13:17:42.447149+0000","last_undegraded":"2024-04-25T13:17:42.447149+0000","last_fullsized":"2024-04-25T13:17:42.447149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.447054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.447054+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.447054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:36.896791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.508496+0000","last_change":"2024-04-25T13:17:46.508524+0000","last_active":"2024-04-25T13:17:46.508496+0000","last_peered":"2024-04-25T13:17:46.508496+0000","last_clean":"2024-04-25T13:17:46.508496+0000","last_became_active":"2024-04-25T13:16:21.681460+0000","last_became_peered":"2024-04-25T13:16:21.681460+0000","last_unstale":"2024-04-25T13:17:46.508496+0000","last_undegraded":"2024-04-25T13:17:46.508496+0000","last_fullsized":"2024-04-25T13:17:46.508496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.508414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.508414+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.508414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:36.709237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.313619+0000","last_change":"2024-04-25T13:17:46.313642+0000","last_active":"2024-04-25T13:17:46.313619+0000","last_peered":"2024-04-25T13:17:46.313619+0000","last_clean":"2024-04-25T13:17:46.313619+0000","last_became_active":"2024-04-25T13:16:21.672826+0000","last_became_peered":"2024-04-25T13:16:21.672826+0000","last_unstale":"2024-04-25T13:17:46.313619+0000","last_undegraded":"2024-04-25T13:17:46.313619+0000","last_fullsized":"2024-04-25T13:17:46.313619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.313493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.313493+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.313493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:14.686577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.541060+0000","last_change":"2024-04-25T13:17:45.541086+0000","last_active":"2024-04-25T13:17:45.541060+0000","last_peered":"2024-04-25T13:17:45.541060+0000","last_clean":"2024-04-25T13:17:45.541060+0000","last_became_active":"2024-04-25T13:16:21.674405+0000","last_became_peered":"2024-04-25T13:16:21.674405+0000","last_unstale":"2024-04-25T13:17:45.541060+0000","last_undegraded":"2024-04-25T13:17:45.541060+0000","last_fullsized":"2024-04-25T13:17:45.541060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.540973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.540973+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.540973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:46:28.094289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.386614+0000","last_change":"2024-04-25T13:17:42.386636+0000","last_active":"2024-04-25T13:17:42.386614+0000","last_peered":"2024-04-25T13:17:42.386614+0000","last_clean":"2024-04-25T13:17:42.386614+0000","last_became_active":"2024-04-25T13:16:21.665293+0000","last_became_peered":"2024-04-25T13:16:21.665293+0000","last_unstale":"2024-04-25T13:17:42.386614+0000","last_undegraded":"2024-04-25T13:17:42.386614+0000","last_fullsized":"2024-04-25T13:17:42.386614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.386488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.386488+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.386488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:31.339721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.093622+0000","last_change":"2024-04-25T13:17:38.093650+0000","last_active":"2024-04-25T13:17:38.093622+0000","last_peered":"2024-04-25T13:17:38.093622+0000","last_clean":"2024-04-25T13:17:38.093622+0000","last_became_active":"2024-04-25T13:16:21.670176+0000","last_became_peered":"2024-04-25T13:16:21.670176+0000","last_unstale":"2024-04-25T13:17:38.093622+0000","last_undegraded":"2024-04-25T13:17:38.093622+0000","last_fullsized":"2024-04-25T13:17:38.093622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.093530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.093530+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.093530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:30:23.740417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:43.467813+0000","last_change":"2024-04-25T13:17:43.467849+0000","last_active":"2024-04-25T13:17:43.467813+0000","last_peered":"2024-04-25T13:17:43.467813+0000","last_clean":"2024-04-25T13:17:43.467813+0000","last_became_active":"2024-04-25T13:16:21.679928+0000","last_became_peered":"2024-04-25T13:16:21.679928+0000","last_unstale":"2024-04-25T13:17:43.467813+0000","last_undegraded":"2024-04-25T13:17:43.467813+0000","last_fullsized":"2024-04-25T13:17:43.467813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:43.467729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:43.467729+0000","last_clean_scrub_stamp":"2024-04-25T13:17:43.467729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:35.241884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.405073+0000","last_change":"2024-04-25T13:17:46.405097+0000","last_active":"2024-04-25T13:17:46.405073+0000","last_peered":"2024-04-25T13:17:46.405073+0000","last_clean":"2024-04-25T13:17:46.405073+0000","last_became_active":"2024-04-25T13:16:21.670597+0000","last_became_peered":"2024-04-25T13:16:21.670597+0000","last_unstale":"2024-04-25T13:17:46.405073+0000","last_undegraded":"2024-04-25T13:17:46.405073+0000","last_fullsized":"2024-04-25T13:17:46.405073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.404987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.404987+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.404987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:32.509525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:38.793184+0000","last_change":"2024-04-25T13:17:38.793240+0000","last_active":"2024-04-25T13:17:38.793184+0000","last_peered":"2024-04-25T13:17:38.793184+0000","last_clean":"2024-04-25T13:17:38.793184+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:38.793184+0000","last_undegraded":"2024-04-25T13:17:38.793184+0000","last_fullsized":"2024-04-25T13:17:38.793184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:38.793083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:38.793083+0000","last_clean_scrub_stamp":"2024-04-25T13:17:38.793083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:35.641581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:41.673709+0000","last_change":"2024-04-25T13:17:41.673770+0000","last_active":"2024-04-25T13:17:41.673709+0000","last_peered":"2024-04-25T13:17:41.673709+0000","last_clean":"2024-04-25T13:17:41.673709+0000","last_became_active":"2024-04-25T13:17:02.817489+0000","last_became_peered":"2024-04-25T13:17:02.817489+0000","last_unstale":"2024-04-25T13:17:41.673709+0000","last_undegraded":"2024-04-25T13:17:41.673709+0000","last_fullsized":"2024-04-25T13:17:41.673709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:41.673585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:41.673585+0000","last_clean_scrub_stamp":"2024-04-25T13:17:41.673585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:16.191089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.423695+0000","last_change":"2024-04-25T13:17:35.423733+0000","last_active":"2024-04-25T13:17:35.423695+0000","last_peered":"2024-04-25T13:17:35.423695+0000","last_clean":"2024-04-25T13:17:35.423695+0000","last_became_active":"2024-04-25T13:16:21.668783+0000","last_became_peered":"2024-04-25T13:16:21.668783+0000","last_unstale":"2024-04-25T13:17:35.423695+0000","last_undegraded":"2024-04-25T13:17:35.423695+0000","last_fullsized":"2024-04-25T13:17:35.423695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.423598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.423598+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.423598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:44.851709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:44.920133+0000","last_change":"2024-04-25T13:17:44.920170+0000","last_active":"2024-04-25T13:17:44.920133+0000","last_peered":"2024-04-25T13:17:44.920133+0000","last_clean":"2024-04-25T13:17:44.920133+0000","last_became_active":"2024-04-25T13:16:21.676036+0000","last_became_peered":"2024-04-25T13:16:21.676036+0000","last_unstale":"2024-04-25T13:17:44.920133+0000","last_undegraded":"2024-04-25T13:17:44.920133+0000","last_fullsized":"2024-04-25T13:17:44.920133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:44.920031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:44.920031+0000","last_clean_scrub_stamp":"2024-04-25T13:17:44.920031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:56.887229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.121097+0000","last_change":"2024-04-25T13:17:39.121120+0000","last_active":"2024-04-25T13:17:39.121097+0000","last_peered":"2024-04-25T13:17:39.121097+0000","last_clean":"2024-04-25T13:17:39.121097+0000","last_became_active":"2024-04-25T13:16:21.671557+0000","last_became_peered":"2024-04-25T13:16:21.671557+0000","last_unstale":"2024-04-25T13:17:39.121097+0000","last_undegraded":"2024-04-25T13:17:39.121097+0000","last_fullsized":"2024-04-25T13:17:39.121097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.121010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.121010+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.121010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:34:46.876835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.590869+0000","last_change":"2024-04-25T13:17:36.590905+0000","last_active":"2024-04-25T13:17:36.590869+0000","last_peered":"2024-04-25T13:17:36.590869+0000","last_clean":"2024-04-25T13:17:36.590869+0000","last_became_active":"2024-04-25T13:16:21.675799+0000","last_became_peered":"2024-04-25T13:16:21.675799+0000","last_unstale":"2024-04-25T13:17:36.590869+0000","last_undegraded":"2024-04-25T13:17:36.590869+0000","last_fullsized":"2024-04-25T13:17:36.590869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.590787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.590787+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.590787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:12.678692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:39.516906+0000","last_change":"2024-04-25T13:17:39.516931+0000","last_active":"2024-04-25T13:17:39.516906+0000","last_peered":"2024-04-25T13:17:39.516906+0000","last_clean":"2024-04-25T13:17:39.516906+0000","last_became_active":"2024-04-25T13:16:21.676819+0000","last_became_peered":"2024-04-25T13:16:21.676819+0000","last_unstale":"2024-04-25T13:17:39.516906+0000","last_undegraded":"2024-04-25T13:17:39.516906+0000","last_fullsized":"2024-04-25T13:17:39.516906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:39.516819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:39.516819+0000","last_clean_scrub_stamp":"2024-04-25T13:17:39.516819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:19:32.864984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:46.468240+0000","last_change":"2024-04-25T13:17:46.468267+0000","last_active":"2024-04-25T13:17:46.468240+0000","last_peered":"2024-04-25T13:17:46.468240+0000","last_clean":"2024-04-25T13:17:46.468240+0000","last_became_active":"2024-04-25T13:16:21.681706+0000","last_became_peered":"2024-04-25T13:16:21.681706+0000","last_unstale":"2024-04-25T13:17:46.468240+0000","last_undegraded":"2024-04-25T13:17:46.468240+0000","last_fullsized":"2024-04-25T13:17:46.468240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:46.468149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:46.468149+0000","last_clean_scrub_stamp":"2024-04-25T13:17:46.468149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:52.856006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.497635+0000","last_change":"2024-04-25T13:17:45.497676+0000","last_active":"2024-04-25T13:17:45.497635+0000","last_peered":"2024-04-25T13:17:45.497635+0000","last_clean":"2024-04-25T13:17:45.497635+0000","last_became_active":"2024-04-25T13:16:21.681089+0000","last_became_peered":"2024-04-25T13:16:21.681089+0000","last_unstale":"2024-04-25T13:17:45.497635+0000","last_undegraded":"2024-04-25T13:17:45.497635+0000","last_fullsized":"2024-04-25T13:17:45.497635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.497539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.497539+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.497539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:51.160481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.718034+0000","last_change":"2024-04-25T13:17:42.718063+0000","last_active":"2024-04-25T13:17:42.718034+0000","last_peered":"2024-04-25T13:17:42.718034+0000","last_clean":"2024-04-25T13:17:42.718034+0000","last_became_active":"2024-04-25T13:17:02.818740+0000","last_became_peered":"2024-04-25T13:17:02.818740+0000","last_unstale":"2024-04-25T13:17:42.718034+0000","last_undegraded":"2024-04-25T13:17:42.718034+0000","last_fullsized":"2024-04-25T13:17:42.718034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.717947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.717947+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.717947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:18.796984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:35.601559+0000","last_change":"2024-04-25T13:17:35.601594+0000","last_active":"2024-04-25T13:17:35.601559+0000","last_peered":"2024-04-25T13:17:35.601559+0000","last_clean":"2024-04-25T13:17:35.601559+0000","last_became_active":"2024-04-25T13:16:21.675005+0000","last_became_peered":"2024-04-25T13:16:21.675005+0000","last_unstale":"2024-04-25T13:17:35.601559+0000","last_undegraded":"2024-04-25T13:17:35.601559+0000","last_fullsized":"2024-04-25T13:17:35.601559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:35.601461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:35.601461+0000","last_clean_scrub_stamp":"2024-04-25T13:17:35.601461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:14:44.546907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.421751+0000","last_change":"2024-04-25T13:17:36.421775+0000","last_active":"2024-04-25T13:17:36.421751+0000","last_peered":"2024-04-25T13:17:36.421751+0000","last_clean":"2024-04-25T13:17:36.421751+0000","last_became_active":"2024-04-25T13:16:21.667060+0000","last_became_peered":"2024-04-25T13:16:21.667060+0000","last_unstale":"2024-04-25T13:17:36.421751+0000","last_undegraded":"2024-04-25T13:17:36.421751+0000","last_fullsized":"2024-04-25T13:17:36.421751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.421635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.421635+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.421635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:46.540504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:36.406697+0000","last_change":"2024-04-25T13:17:36.406719+0000","last_active":"2024-04-25T13:17:36.406697+0000","last_peered":"2024-04-25T13:17:36.406697+0000","last_clean":"2024-04-25T13:17:36.406697+0000","last_became_active":"2024-04-25T13:16:21.668756+0000","last_became_peered":"2024-04-25T13:16:21.668756+0000","last_unstale":"2024-04-25T13:17:36.406697+0000","last_undegraded":"2024-04-25T13:17:36.406697+0000","last_fullsized":"2024-04-25T13:17:36.406697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:36.406578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:36.406578+0000","last_clean_scrub_stamp":"2024-04-25T13:17:36.406578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:17:24.970289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:45.360992+0000","last_change":"2024-04-25T13:17:45.361018+0000","last_active":"2024-04-25T13:17:45.360992+0000","last_peered":"2024-04-25T13:17:45.360992+0000","last_clean":"2024-04-25T13:17:45.360992+0000","last_became_active":"2024-04-25T13:16:21.669454+0000","last_became_peered":"2024-04-25T13:16:21.669454+0000","last_unstale":"2024-04-25T13:17:45.360992+0000","last_undegraded":"2024-04-25T13:17:45.360992+0000","last_fullsized":"2024-04-25T13:17:45.360992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:45.360875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:45.360875+0000","last_clean_scrub_stamp":"2024-04-25T13:17:45.360875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:43.566744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:47.266120+0000","last_change":"2024-04-25T13:17:47.266146+0000","last_active":"2024-04-25T13:17:47.266120+0000","last_peered":"2024-04-25T13:17:47.266120+0000","last_clean":"2024-04-25T13:17:47.266120+0000","last_became_active":"2024-04-25T13:16:21.672192+0000","last_became_peered":"2024-04-25T13:16:21.672192+0000","last_unstale":"2024-04-25T13:17:47.266120+0000","last_undegraded":"2024-04-25T13:17:47.266120+0000","last_fullsized":"2024-04-25T13:17:47.266120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:47.266039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:47.266039+0000","last_clean_scrub_stamp":"2024-04-25T13:17:47.266039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:57.522107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:37.124930+0000","last_change":"2024-04-25T13:17:37.124951+0000","last_active":"2024-04-25T13:17:37.124930+0000","last_peered":"2024-04-25T13:17:37.124930+0000","last_clean":"2024-04-25T13:17:37.124930+0000","last_became_active":"2024-04-25T13:16:21.669683+0000","last_became_peered":"2024-04-25T13:16:21.669683+0000","last_unstale":"2024-04-25T13:17:37.124930+0000","last_undegraded":"2024-04-25T13:17:37.124930+0000","last_fullsized":"2024-04-25T13:17:37.124930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:37.124843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:37.124843+0000","last_clean_scrub_stamp":"2024-04-25T13:17:37.124843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:56.150641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:42.858844+0000","last_change":"2024-04-25T13:17:42.858869+0000","last_active":"2024-04-25T13:17:42.858844+0000","last_peered":"2024-04-25T13:17:42.858844+0000","last_clean":"2024-04-25T13:17:42.858844+0000","last_became_active":"2024-04-25T13:16:21.667345+0000","last_became_peered":"2024-04-25T13:16:21.667345+0000","last_unstale":"2024-04-25T13:17:42.858844+0000","last_undegraded":"2024-04-25T13:17:42.858844+0000","last_fullsized":"2024-04-25T13:17:42.858844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:42.858762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:42.858762+0000","last_clean_scrub_stamp":"2024-04-25T13:17:42.858762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:51.900721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T13:17:48.435095+0000","last_change":"2024-04-25T13:17:48.435120+0000","last_active":"2024-04-25T13:17:48.435095+0000","last_peered":"2024-04-25T13:17:48.435095+0000","last_clean":"2024-04-25T13:17:48.435095+0000","last_became_active":"2024-04-25T13:16:21.676093+0000","last_became_peered":"2024-04-25T13:16:21.676093+0000","last_unstale":"2024-04-25T13:17:48.435095+0000","last_undegraded":"2024-04-25T13:17:48.435095+0000","last_fullsized":"2024-04-25T13:17:48.435095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:17:48.435006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:17:48.435006+0000","last_clean_scrub_stamp":"2024-04-25T13:17:48.435006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:37.831514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12592,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":25184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":712090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":124836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":123554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":120952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":124870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":121084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":120572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":710282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:17:56.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T13:17:56.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.527+0000 7fd2db08a640 1 Processor -- start 2024-04-25T13:17:56.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.527+0000 7fd2db08a640 1 -- start start 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.527+0000 7fd2db08a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c8340 0x7fd2d40723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2db08a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4151b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2db08a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d4157d70 con 0x7fd2d4158b10 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2db08a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d4158680 con 0x7fd2d40c8340 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2db08a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d415be10 con 0x7fd2d40c8720 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c8340 0x7fd2d40723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd2d40c8340 0x7fd2d40723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53548/0 (socket says 172.21.15.155:53548) 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 -- 172.21.15.155:0/955565657 learned_addr learned my addr 172.21.15.155:0/955565657 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d9627640 1 --2- 172.21.15.155:0/955565657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 -- 172.21.15.155:0/955565657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 msgr2=0x7fd2d4151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 --2- 172.21.15.155:0/955565657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 -- 172.21.15.155:0/955565657 >> v1:172.21.15.155:6789/0 conn(0x7fd2d4158b10 legacy=0x7fd2d415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.528+0000 7fd2d8e26640 1 -- 172.21.15.155:0/955565657 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d415c0f0 con 0x7fd2d40c8340 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.529+0000 7fd2d8e26640 1 --2- 172.21.15.155:0/955565657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d40723b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800bb10 tx=0x7fd2c802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9acfa2ef009ce5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.529+0000 7fd2d37fe640 1 -- 172.21.15.155:0/955565657 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8036020 con 0x7fd2d40c8340 2024-04-25T13:17:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.529+0000 7fd2d37fe640 1 -- 172.21.15.155:0/955565657 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8032820 con 0x7fd2d40c8340 2024-04-25T13:17:56.531 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.529+0000 7fd2d37fe640 1 -- 172.21.15.155:0/955565657 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8032bf0 con 0x7fd2d40c8340 2024-04-25T13:17:56.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.529+0000 7fd2db08a640 1 -- 172.21.15.155:0/955565657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 msgr2=0x7fd2d40723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.533 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.529+0000 7fd2db08a640 1 --2- 172.21.15.155:0/955565657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d40723b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800bb10 tx=0x7fd2c802c920 comp rx=0 tx=0).stop 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.530+0000 7fd2db08a640 1 -- 172.21.15.155:0/955565657 shutdown_connections 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.530+0000 7fd2db08a640 1 --2- 172.21.15.155:0/955565657 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.530+0000 7fd2db08a640 1 --2- 172.21.15.155:0/955565657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d40723b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.530+0000 7fd2db08a640 1 -- 172.21.15.155:0/955565657 >> 172.21.15.155:0/955565657 conn(0x7fd2d406d660 msgr2=0x7fd2d4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.530+0000 7fd2db08a640 1 -- 172.21.15.155:0/955565657 shutdown_connections 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.530+0000 7fd2db08a640 1 -- 172.21.15.155:0/955565657 wait complete. 2024-04-25T13:17:56.534 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.531+0000 7fd2db08a640 1 Processor -- start 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.531+0000 7fd2db08a640 1 -- start start 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d41f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2d4158b10 0x7fd2d41f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d40728f0 con 0x7fd2d40c8340 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d4158310 con 0x7fd2d4158b10 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d415ba70 con 0x7fd2d40c8720 2024-04-25T13:17:56.535 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d41f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d41f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53552/0 (socket says 172.21.15.155:53552) 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 -- 172.21.15.155:0/1770246072 learned_addr learned my addr 172.21.15.155:0/1770246072 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d9627640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2d4158b10 0x7fd2d41f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d3fff640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 -- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 msgr2=0x7fd2d4150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 -- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2d4158b10 msgr2=0x7fd2d41f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2d4158b10 0x7fd2d41f0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.536 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 -- 172.21.15.155:0/1770246072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d41f1380 con 0x7fd2d40c8340 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d8e26640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d41f1f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802c960 tx=0x7fd2c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8036040 con 0x7fd2d40c8340 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8031c30 con 0x7fd2d40c8340 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d41f1640 con 0x7fd2d40c8340 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8044480 con 0x7fd2d40c8340 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.532+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d4158f30 con 0x7fd2d40c8340 2024-04-25T13:17:56.537 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.533+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d4068f50 con 0x7fd2d40c8340 2024-04-25T13:17:56.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.534+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2c8039020 con 0x7fd2d40c8340 2024-04-25T13:17:56.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.534+0000 7fd2d17fa640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd2b806c920 0x7fd2b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.538 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.534+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd2c80aced0 con 0x7fd2d40c8340 2024-04-25T13:17:56.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.534+0000 7fd2d3fff640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd2b806c920 0x7fd2b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.535+0000 7fd2d3fff640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd2b806c920 0x7fd2b806ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd2d414bf40 tx=0x7fd2c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.539+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd2c802f070 con 0x7fd2d40c8340 2024-04-25T13:17:56.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.725+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd2d4071830 con 0x7fd2d40c8340 2024-04-25T13:17:56.728 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.728+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fd2c807af00 con 0x7fd2d40c8340 2024-04-25T13:17:56.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.729+0000 7fd2d17fa640 1 -- 172.21.15.155:0/1770246072 <== mon.0 v2:172.21.15.155:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd2c807a800 con 0x7fd2d40c8340 2024-04-25T13:17:56.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd2b806c920 msgr2=0x7fd2b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd2b806c920 0x7fd2b806ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd2d414bf40 tx=0x7fd2c0009040 comp rx=0 tx=0).stop 2024-04-25T13:17:56.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 msgr2=0x7fd2d41f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d41f1f20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802c960 tx=0x7fd2c80046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 shutdown_connections 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd2d4158b10 0x7fd2d41f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fd2b806c920 0x7fd2b806ede0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fd2d40c8720 0x7fd2d4150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 --2- 172.21.15.155:0/1770246072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd2d40c8340 0x7fd2d41f1f20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 >> 172.21.15.155:0/1770246072 conn(0x7fd2d406d660 msgr2=0x7fd2d406ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 shutdown_connections 2024-04-25T13:17:56.732 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.731+0000 7fd2db08a640 1 -- 172.21.15.155:0/1770246072 wait complete. 2024-04-25T13:17:56.743 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:17:56.743 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:56.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.844+0000 7f4bc67cd640 1 Processor -- start 2024-04-25T13:17:56.844 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.844+0000 7f4bc67cd640 1 -- start start 2024-04-25T13:17:56.845 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bc67cd640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f4bc0151ea0 0x7f4bc00c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bc67cd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc015b610 con 0x7f4bc0152280 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bc67cd640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc006e6f0 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bc67cd640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc006f300 con 0x7f4bc0151ea0 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbf7fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4bc0152280 0x7f4bc01591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54152/0 (socket says 172.21.15.155:54152) 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbf7fe640 1 -- 172.21.15.155:0/3281223268 learned_addr learned my addr 172.21.15.155:0/3281223268 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbffff640 1 --2- 172.21.15.155:0/3281223268 >> v2:172.21.15.191:3300/0 conn(0x7f4bc0151ea0 0x7f4bc00c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbeffd640 1 -- 172.21.15.155:0/3281223268 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939446089 0 0) 0x7f4bc015b610 con 0x7f4bc0152280 2024-04-25T13:17:56.846 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbeffd640 1 -- 172.21.15.155:0/3281223268 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ba8005730 con 0x7f4bc0152280 2024-04-25T13:17:56.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbffff640 1 -- 172.21.15.155:0/3281223268 >> v1:172.21.15.191:6789/0 conn(0x7f4bc00c3cb0 legacy=0x7f4bc0162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbffff640 1 -- 172.21.15.155:0/3281223268 >> v1:172.21.15.155:6789/0 conn(0x7f4bc0152280 legacy=0x7f4bc01591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.845+0000 7f4bbffff640 1 -- 172.21.15.155:0/3281223268 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc006e9d0 con 0x7f4bc0151ea0 2024-04-25T13:17:56.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.846+0000 7f4bbffff640 1 --2- 172.21.15.155:0/3281223268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc0151ea0 0x7f4bc00c7f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00097a0 tx=0x7f4bb002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1c7b81d16ffd9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.846+0000 7f4bbeffd640 1 -- 172.21.15.155:0/3281223268 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0037070 con 0x7f4bc0151ea0 2024-04-25T13:17:56.848 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.846+0000 7f4bbeffd640 1 -- 172.21.15.155:0/3281223268 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4bb0032640 con 0x7f4bc0151ea0 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.846+0000 7f4bbeffd640 1 -- 172.21.15.155:0/3281223268 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0032a30 con 0x7f4bc0151ea0 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 -- 172.21.15.155:0/3281223268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc0151ea0 msgr2=0x7f4bc00c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/3281223268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc0151ea0 0x7f4bc00c7f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4bb00097a0 tx=0x7f4bb002a2c0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 -- 172.21.15.155:0/3281223268 shutdown_connections 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/3281223268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc0151ea0 0x7f4bc00c7f10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 -- 172.21.15.155:0/3281223268 >> 172.21.15.155:0/3281223268 conn(0x7f4bc00c8f00 msgr2=0x7f4bc00c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 -- 172.21.15.155:0/3281223268 shutdown_connections 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.847+0000 7f4bc67cd640 1 -- 172.21.15.155:0/3281223268 wait complete. 2024-04-25T13:17:56.849 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.848+0000 7f4bc67cd640 1 Processor -- start 2024-04-25T13:17:56.850 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.848+0000 7f4bc67cd640 1 -- start start 2024-04-25T13:17:56.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc67cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 0x7f4bc00c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc67cd640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc0151ea0 0x7f4bc01ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc67cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc01589c0 0x7f4bc0073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc67cd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc00c8cb0 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc67cd640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc006ef90 con 0x7f4bc01589c0 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc67cd640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc015b2d0 con 0x7f4bc0151ea0 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 0x7f4bc00c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 0x7f4bc00c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53564/0 (socket says 172.21.15.155:53564) 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 -- 172.21.15.155:0/2886569981 learned_addr learned my addr 172.21.15.155:0/2886569981 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbf7fe640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc0151ea0 0x7f4bc01ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bc4d6a640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc01589c0 0x7f4bc0073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 -- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc0151ea0 msgr2=0x7f4bc01ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc0151ea0 0x7f4bc01ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 -- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc01589c0 msgr2=0x7f4bc0073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc01589c0 0x7f4bc0073850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.849+0000 7f4bbffff640 1 -- 172.21.15.155:0/2886569981 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc00c5460 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.850+0000 7f4bbffff640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 0x7f4bc00c4f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0035040 tx=0x7f4bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.850+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0037050 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.850+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc01ecfe0 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.850+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4bb0038040 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.850+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0004270 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.850+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc01ed5a0 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.851+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc0068e40 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.852+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bb0030980 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.852+0000 7f4bbcff9640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bac06c8f0 0x7f4bac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.852+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4bb00acab0 con 0x7f4bc00c3cb0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.852+0000 7f4bbf7fe640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bac06c8f0 0x7f4bac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:56.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.852+0000 7f4bbf7fe640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bac06c8f0 0x7f4bac06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0074480 tx=0x7f4bb4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:56.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:56.860+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4bb007a4a0 con 0x7f4bc00c3cb0 2024-04-25T13:17:57.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.079+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bc0072100 con 0x7f4bc00c3cb0 2024-04-25T13:17:57.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.080+0000 7f4bbcff9640 1 -- 172.21.15.155:0/2886569981 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6926 (secure 0 0 0) 0x7f4bb007e7a0 con 0x7f4bc00c3cb0 2024-04-25T13:17:57.080 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:57.080 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:17:11.835312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4305,"mds_1":4297,"mds_2":4284,"mds_3":4282,"mds_4":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":16,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"c","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4278,4282,4284,4297,4305]},"id":1}]} 2024-04-25T13:17:57.081 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-04-25T13:17:57.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bac06c8f0 msgr2=0x7f4bac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bac06c8f0 0x7f4bac06edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0074480 tx=0x7f4bb4007d30 comp rx=0 tx=0).stop 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 msgr2=0x7f4bc00c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 0x7f4bc00c4f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0035040 tx=0x7f4bb00046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 shutdown_connections 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4bc01589c0 0x7f4bc0073850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f4bac06c8f0 0x7f4bac06edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f4bc0151ea0 0x7f4bc01ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 --2- 172.21.15.155:0/2886569981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bc00c3cb0 0x7f4bc00c4f20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.083 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 >> 172.21.15.155:0/2886569981 conn(0x7f4bc00c8f00 msgr2=0x7f4bc0150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:57.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 shutdown_connections 2024-04-25T13:17:57.084 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.082+0000 7f4bc67cd640 1 -- 172.21.15.155:0/2886569981 wait complete. 2024-04-25T13:17:57.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:17:57.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.193+0000 7fc04406b640 1 Processor -- start 2024-04-25T13:17:57.194 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.193+0000 7fc04406b640 1 -- start start 2024-04-25T13:17:57.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc04406b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc03c144300 0x7fc03c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.197 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc04406b640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7fc03c075850 0x7fc03c074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc04406b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03c0cd830 con 0x7fc03c15f2a0 2024-04-25T13:17:57.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc04406b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c15ee10 con 0x7fc03c144300 2024-04-25T13:17:57.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc04406b640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7fc03c1446e0 con 0x7fc03c075850 2024-04-25T13:17:57.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc041e07640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc03c144300 0x7fc03c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.198 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc041e07640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc03c144300 0x7fc03c0c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53578/0 (socket says 172.21.15.155:53578) 2024-04-25T13:17:57.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc041e07640 1 -- 172.21.15.155:0/280593483 learned_addr learned my addr 172.21.15.155:0/280593483 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:57.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.194+0000 7fc041606640 1 --1- 172.21.15.155:0/280593483 >> v1:172.21.15.155:6789/0 conn(0x7fc03c15f2a0 0x7fc03c15b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54154/0 (socket says 172.21.15.155:54154) 2024-04-25T13:17:57.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc042608640 1 --2- 172.21.15.155:0/280593483 >> v2:172.21.15.191:3300/0 conn(0x7fc03c075850 0x7fc03c074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc041e07640 1 -- 172.21.15.155:0/280593483 >> v2:172.21.15.191:3300/0 conn(0x7fc03c075850 msgr2=0x7fc03c074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:57.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc041e07640 1 --2- 172.21.15.155:0/280593483 >> v2:172.21.15.191:3300/0 conn(0x7fc03c075850 0x7fc03c074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc041e07640 1 -- 172.21.15.155:0/280593483 >> v1:172.21.15.155:6789/0 conn(0x7fc03c15f2a0 legacy=0x7fc03c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc041e07640 1 -- 172.21.15.155:0/280593483 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c0c93b0 con 0x7fc03c144300 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc041e07640 1 --2- 172.21.15.155:0/280593483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c144300 0x7fc03c0c8e70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0cb100 tx=0x7fc02c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb1b9319126ef40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.195+0000 7fc040e05640 1 -- 172.21.15.155:0/280593483 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c037070 con 0x7fc03c144300 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc040e05640 1 -- 172.21.15.155:0/280593483 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc02c02ae50 con 0x7fc03c144300 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc040e05640 1 -- 172.21.15.155:0/280593483 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c032880 con 0x7fc03c144300 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 -- 172.21.15.155:0/280593483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c144300 msgr2=0x7fc03c0c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.200 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 --2- 172.21.15.155:0/280593483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c144300 0x7fc03c0c8e70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0cb100 tx=0x7fc02c02a300 comp rx=0 tx=0).stop 2024-04-25T13:17:57.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 -- 172.21.15.155:0/280593483 shutdown_connections 2024-04-25T13:17:57.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 --2- 172.21.15.155:0/280593483 >> v2:172.21.15.191:3300/0 conn(0x7fc03c075850 0x7fc03c074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 --2- 172.21.15.155:0/280593483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c144300 0x7fc03c0c8e70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 -- 172.21.15.155:0/280593483 >> 172.21.15.155:0/280593483 conn(0x7fc03c06b920 msgr2=0x7fc03c06bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:57.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 -- 172.21.15.155:0/280593483 shutdown_connections 2024-04-25T13:17:57.201 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.196+0000 7fc04406b640 1 -- 172.21.15.155:0/280593483 wait complete. 2024-04-25T13:17:57.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.197+0000 7fc04406b640 1 Processor -- start 2024-04-25T13:17:57.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.197+0000 7fc04406b640 1 -- start start 2024-04-25T13:17:57.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc04406b640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03c075850 0x7fc03c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc04406b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc03c144300 0x7fc03c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc04406b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 0x7fc03c1f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc04406b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c15e7c0 con 0x7fc03c15f2a0 2024-04-25T13:17:57.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc04406b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c15bda0 con 0x7fc03c144300 2024-04-25T13:17:57.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc04406b640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7fc03c15eaa0 con 0x7fc03c075850 2024-04-25T13:17:57.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 0x7fc03c1f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 0x7fc03c1f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53592/0 (socket says 172.21.15.155:53592) 2024-04-25T13:17:57.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 -- 172.21.15.155:0/703502069 learned_addr learned my addr 172.21.15.155:0/703502069 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:57.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc041606640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc03c144300 0x7fc03c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.206 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc041e07640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03c075850 0x7fc03c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 -- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03c075850 msgr2=0x7fc03c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03c075850 0x7fc03c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 -- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc03c144300 msgr2=0x7fc03c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc03c144300 0x7fc03c0723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.198+0000 7fc042608640 1 -- 172.21.15.155:0/703502069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c1e5670 con 0x7fc03c15f2a0 2024-04-25T13:17:57.207 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.199+0000 7fc042608640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 0x7fc03c1f2030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc034007e70 tx=0x7fc03400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.199+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034014620 con 0x7fc03c15f2a0 2024-04-25T13:17:57.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.199+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc034019070 con 0x7fc03c15f2a0 2024-04-25T13:17:57.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.199+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034014a40 con 0x7fc03c15f2a0 2024-04-25T13:17:57.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.199+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c1e5950 con 0x7fc03c15f2a0 2024-04-25T13:17:57.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.199+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c1e5f10 con 0x7fc03c15f2a0 2024-04-25T13:17:57.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.200+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03c068e40 con 0x7fc03c15f2a0 2024-04-25T13:17:57.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.200+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc034014be0 con 0x7fc03c15f2a0 2024-04-25T13:17:57.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.201+0000 7fc0327fc640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc02006c920 0x7fc02006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.201+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc03408c7c0 con 0x7fc03c15f2a0 2024-04-25T13:17:57.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.201+0000 7fc041e07640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc02006c920 0x7fc02006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.201+0000 7fc041e07640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc02006c920 0x7fc02006ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc02c034000 tx=0x7fc02c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.209+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc03405a880 con 0x7fc03c15f2a0 2024-04-25T13:17:57.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.431+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc03c0c8110 con 0x7fc03c15f2a0 2024-04-25T13:17:57.431 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.431+0000 7fc0327fc640 1 -- 172.21.15.155:0/703502069 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6926 (secure 0 0 0) 0x7fc03405a180 con 0x7fc03c15f2a0 2024-04-25T13:17:57.432 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:57.432 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6836/2328925950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6833","nonce":2328925950},{"type":"v1","addr":"172.21.15.191:6836","nonce":2328925950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:16:20.990091+0000","modified":"2024-04-25T13:17:11.835312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4305,"mds_1":4297,"mds_2":4284,"mds_3":4282,"mds_4":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":4,"incarnation":17,"state":"up:active","state_seq":16,"addr":"172.21.15.155:6835/2131538111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2131538111},{"type":"v1","addr":"172.21.15.155:6835","nonce":2131538111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"c","rank":3,"incarnation":15,"state":"up:active","state_seq":14,"addr":"172.21.15.155:6837/290614525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":290614525},{"type":"v1","addr":"172.21.15.155:6837","nonce":290614525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":13,"state":"up:active","state_seq":13,"addr":"172.21.15.155:6839/3774335819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":3774335819},{"type":"v1","addr":"172.21.15.155:6839","nonce":3774335819}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4297":{"gid":4297,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6834/1291944552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":1291944552},{"type":"v1","addr":"172.21.15.191:6834","nonce":1291944552}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.191:6837/2351082662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6835","nonce":2351082662},{"type":"v1","addr":"172.21.15.191:6837","nonce":2351082662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4278,4282,4284,4297,4305]},"id":1}]} 2024-04-25T13:17:57.432 INFO:teuthology.orchestra.run.smithi155.stderr:dumped fsmap epoch 18 2024-04-25T13:17:57.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc02006c920 msgr2=0x7fc02006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc02006c920 0x7fc02006ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc02c034000 tx=0x7fc02c02e000 comp rx=0 tx=0).stop 2024-04-25T13:17:57.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 msgr2=0x7fc03c1f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 0x7fc03c1f2030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc034007e70 tx=0x7fc03400e4b0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.434 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 shutdown_connections 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc03c15f2a0 0x7fc03c1f2030 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc03c144300 0x7fc03c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7fc02006c920 0x7fc02006ede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 --2- 172.21.15.155:0/703502069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7fc03c075850 0x7fc03c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 >> 172.21.15.155:0/703502069 conn(0x7fc03c06b920 msgr2=0x7fc03c141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 shutdown_connections 2024-04-25T13:17:57.435 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.434+0000 7fc04406b640 1 -- 172.21.15.155:0/703502069 wait complete. 2024-04-25T13:17:57.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:17:57.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.543+0000 7f5267623640 1 Processor -- start 2024-04-25T13:17:57.543 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.543+0000 7f5267623640 1 -- start start 2024-04-25T13:17:57.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5267623640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7f52601554e0 0x7f526015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5267623640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52601558c0 con 0x7f52600d08a0 2024-04-25T13:17:57.545 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5267623640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526015f630 con 0x7f52600b3c00 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5267623640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7f52600b4a80 con 0x7f52601554e0 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5265bc0640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f52600d08a0 0x7f5260165a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54162/0 (socket says 172.21.15.155:54162) 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5265bc0640 1 -- 172.21.15.155:0/1891486666 learned_addr learned my addr 172.21.15.155:0/1891486666 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f52653bf640 1 --2- 172.21.15.155:0/1891486666 >> v2:172.21.15.191:3300/0 conn(0x7f52601554e0 0x7f526015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5253fff640 1 -- 172.21.15.155:0/1891486666 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251956239 0 0) 0x7f5258001490 con 0x7f52600d08a0 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f5253fff640 1 -- 172.21.15.155:0/1891486666 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f524c003520 con 0x7f52600d08a0 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f52653bf640 1 -- 172.21.15.155:0/1891486666 >> v1:172.21.15.191:6789/0 conn(0x7f52600b3c00 legacy=0x7f52600b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.546 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f52653bf640 1 -- 172.21.15.155:0/1891486666 >> v1:172.21.15.155:6789/0 conn(0x7f52600d08a0 legacy=0x7f5260165a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.544+0000 7f52653bf640 1 -- 172.21.15.155:0/1891486666 --> v2:172.21.15.191:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600cb8c0 con 0x7f52601554e0 2024-04-25T13:17:57.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.545+0000 7f52653bf640 1 --2- 172.21.15.155:0/1891486666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52601554e0 0x7f526015f0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52600b4c00 tx=0x7f525402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24884d424f2abf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.545+0000 7f5253fff640 1 -- 172.21.15.155:0/1891486666 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254037070 con 0x7f52601554e0 2024-04-25T13:17:57.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.545+0000 7f5253fff640 1 -- 172.21.15.155:0/1891486666 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5254032640 con 0x7f52601554e0 2024-04-25T13:17:57.547 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.545+0000 7f5253fff640 1 -- 172.21.15.155:0/1891486666 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540329f0 con 0x7f52601554e0 2024-04-25T13:17:57.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 -- 172.21.15.155:0/1891486666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52601554e0 msgr2=0x7f526015f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 --2- 172.21.15.155:0/1891486666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52601554e0 0x7f526015f0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52600b4c00 tx=0x7f525402a2c0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.550 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 -- 172.21.15.155:0/1891486666 shutdown_connections 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 --2- 172.21.15.155:0/1891486666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52601554e0 0x7f526015f0f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 -- 172.21.15.155:0/1891486666 >> 172.21.15.155:0/1891486666 conn(0x7f5260074d50 msgr2=0x7f5260075130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 -- 172.21.15.155:0/1891486666 shutdown_connections 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.546+0000 7f5267623640 1 -- 172.21.15.155:0/1891486666 wait complete. 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.547+0000 7f5267623640 1 Processor -- start 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.547+0000 7f5267623640 1 -- start start 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5267623640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52600b3c00 0x7f52600c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5267623640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52600d08a0 0x7f52600ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.551 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5267623640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 0x7f52600ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5267623640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52600b4430 con 0x7f52601554e0 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5267623640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f52600b4150 con 0x7f52600d08a0 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5267623640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f52600b4710 con 0x7f52600b3c00 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 0x7f52600ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 0x7f52600ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53608/0 (socket says 172.21.15.155:53608) 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 -- 172.21.15.155:0/336955794 learned_addr learned my addr 172.21.15.155:0/336955794 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f52653bf640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52600b3c00 0x7f52600c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5264bbe640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52600d08a0 0x7f52600ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.552 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 -- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52600b3c00 msgr2=0x7f52600c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52600b3c00 0x7f52600c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 -- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52600d08a0 msgr2=0x7f52600ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52600d08a0 0x7f52600ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 -- 172.21.15.155:0/336955794 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52601f1bd0 con 0x7f52601554e0 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5265bc0640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 0x7f52600ca820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f525800cbc0 tx=0x7f525800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.548+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258017070 con 0x7f52601554e0 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.549+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f525800ad40 con 0x7f52601554e0 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.549+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258012600 con 0x7f52601554e0 2024-04-25T13:17:57.553 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.549+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52600c7d50 con 0x7f52601554e0 2024-04-25T13:17:57.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.549+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52600c8310 con 0x7f52601554e0 2024-04-25T13:17:57.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.550+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5260068e40 con 0x7f52601554e0 2024-04-25T13:17:57.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.550+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f525801a070 con 0x7f52601554e0 2024-04-25T13:17:57.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.550+0000 7f5251ffb640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f524406c8f0 0x7f524406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.551+0000 7f52653bf640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f524406c8f0 0x7f524406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.554 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.551+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f525808bc90 con 0x7f52601554e0 2024-04-25T13:17:57.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.551+0000 7f52653bf640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f524406c8f0 0x7f524406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5254034000 tx=0x7f525402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.555 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.555+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52601558c0 con 0x7f52601554e0 2024-04-25T13:17:57.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.739+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52600cc260 con 0x7f52601554e0 2024-04-25T13:17:57.740 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.741+0000 7f5251ffb640 1 -- 172.21.15.155:0/336955794 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18907 (secure 0 0 0) 0x7f52580595f0 con 0x7f52601554e0 2024-04-25T13:17:57.741 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-04-25T13:17:57.741 INFO:teuthology.orchestra.run.smithi155.stdout:{"epoch":27,"fsid":"99137c81-994c-40b7-8b7f-aeb03a97ab57","created":"2024-04-25T13:15:57.477211+0000","modified":"2024-04-25T13:17:02.804855+0000","last_up_change":"2024-04-25T13:16:08.612109+0000","last_in_change":"2024-04-25T13:15:59.542202+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:16:09.629756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:16:19.529860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:16:19.949095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T13:16:23.675819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6a864f78-48bb-4c21-8263-ab0df95ced2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6801","nonce":2134228032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6804","nonce":2134228032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6812","nonce":2134228032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2134228032},{"type":"v1","addr":"172.21.15.155:6808","nonce":2134228032}]},"public_addr":"172.21.15.155:6801/2134228032","cluster_addr":"172.21.15.155:6804/2134228032","heartbeat_back_addr":"172.21.15.155:6812/2134228032","heartbeat_front_addr":"172.21.15.155:6808/2134228032","state":["exists","up"]},{"osd":1,"uuid":"48c0d97f-fdb1-4e52-b2b3-ffbfa7aae790","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6817","nonce":3446698651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6819","nonce":3446698651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6823","nonce":3446698651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3446698651},{"type":"v1","addr":"172.21.15.155:6821","nonce":3446698651}]},"public_addr":"172.21.15.155:6817/3446698651","cluster_addr":"172.21.15.155:6819/3446698651","heartbeat_back_addr":"172.21.15.155:6823/3446698651","heartbeat_front_addr":"172.21.15.155:6821/3446698651","state":["exists","up"]},{"osd":2,"uuid":"493b0471-6e11-4379-b815-b7693e3fe47e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6825","nonce":3777344599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6827","nonce":3777344599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6831","nonce":3777344599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3777344599},{"type":"v1","addr":"172.21.15.155:6829","nonce":3777344599}]},"public_addr":"172.21.15.155:6825/3777344599","cluster_addr":"172.21.15.155:6827/3777344599","heartbeat_back_addr":"172.21.15.155:6831/3777344599","heartbeat_front_addr":"172.21.15.155:6829/3777344599","state":["exists","up"]},{"osd":3,"uuid":"41c21def-1bb7-40b4-9a6a-1695e2a0def5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6805","nonce":1299092023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6807","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6809","nonce":1299092023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6815","nonce":1299092023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6811","nonce":1299092023},{"type":"v1","addr":"172.21.15.155:6813","nonce":1299092023}]},"public_addr":"172.21.15.155:6805/1299092023","cluster_addr":"172.21.15.155:6809/1299092023","heartbeat_back_addr":"172.21.15.155:6815/1299092023","heartbeat_front_addr":"172.21.15.155:6813/1299092023","state":["exists","up"]},{"osd":4,"uuid":"b9674f31-0811-422e-a137-db684b8a7814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6804","nonce":2288973653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6808","nonce":2288973653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6815","nonce":2288973653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":2288973653},{"type":"v1","addr":"172.21.15.191:6812","nonce":2288973653}]},"public_addr":"172.21.15.191:6804/2288973653","cluster_addr":"172.21.15.191:6808/2288973653","heartbeat_back_addr":"172.21.15.191:6815/2288973653","heartbeat_front_addr":"172.21.15.191:6812/2288973653","state":["exists","up"]},{"osd":5,"uuid":"6b89ca33-6982-4889-9d63-91043b7a33cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6801","nonce":2170630618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6803","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6805","nonce":2170630618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6813","nonce":2170630618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":2170630618},{"type":"v1","addr":"172.21.15.191:6809","nonce":2170630618}]},"public_addr":"172.21.15.191:6801/2170630618","cluster_addr":"172.21.15.191:6805/2170630618","heartbeat_back_addr":"172.21.15.191:6813/2170630618","heartbeat_front_addr":"172.21.15.191:6809/2170630618","state":["exists","up"]},{"osd":6,"uuid":"34e96272-8cb2-4ee7-afc9-8266df39e33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6825","nonce":1440480290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6827","nonce":1440480290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6831","nonce":1440480290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":1440480290},{"type":"v1","addr":"172.21.15.191:6829","nonce":1440480290}]},"public_addr":"172.21.15.191:6825/1440480290","cluster_addr":"172.21.15.191:6827/1440480290","heartbeat_back_addr":"172.21.15.191:6831/1440480290","heartbeat_front_addr":"172.21.15.191:6829/1440480290","state":["exists","up"]},{"osd":7,"uuid":"fd957394-6698-435b-aaa2-36c622cefd45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6817","nonce":3056123415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6819","nonce":3056123415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6823","nonce":3056123415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":3056123415},{"type":"v1","addr":"172.21.15.191:6821","nonce":3056123415}]},"public_addr":"172.21.15.191:6817/3056123415","cluster_addr":"172.21.15.191:6819/3056123415","heartbeat_back_addr":"172.21.15.191:6823/3056123415","heartbeat_front_addr":"172.21.15.191:6821/3056123415","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.688127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.645899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.716035+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.700446+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.637078+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.689236+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.738588+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:16:04.690584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:17:57.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f524406c8f0 msgr2=0x7f524406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f524406c8f0 0x7f524406edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5254034000 tx=0x7f525402e000 comp rx=0 tx=0).stop 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 msgr2=0x7f52600ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 0x7f52600ca820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f525800cbc0 tx=0x7f525800a430 comp rx=0 tx=0).stop 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 shutdown_connections 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52601554e0 0x7f52600ca820 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f52600d08a0 0x7f52600ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f524406c8f0 0x7f524406edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 --2- 172.21.15.155:0/336955794 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f52600b3c00 0x7f52600c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 >> 172.21.15.155:0/336955794 conn(0x7f5260074d50 msgr2=0x7f52600ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:57.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 shutdown_connections 2024-04-25T13:17:57.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.743+0000 7f5267623640 1 -- 172.21.15.155:0/336955794 wait complete. 2024-04-25T13:17:57.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:17:57.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.852+0000 7feecb6ae640 1 Processor -- start 2024-04-25T13:17:57.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.852+0000 7feecb6ae640 1 -- start start 2024-04-25T13:17:57.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feecb6ae640 1 --2- >> v2:172.21.15.191:3300/0 conn(0x7feec4155170 0x7feec415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.853 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feecb6ae640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec4155550 0x7feec40d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feecb6ae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feec40cb9e0 0x7feec40d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feecb6ae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7feec40cddf0 con 0x7feec40cb9e0 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feecb6ae640 1 -- --> v2:172.21.15.191:3300/0 -- mon_getmap magic: 0 -- 0x7feec415f430 con 0x7feec4155170 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feecb6ae640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7feec40ccf00 con 0x7feec4155550 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feec40cb9e0 0x7feec40d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7feec40cb9e0 0x7feec40d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53614/0 (socket says 172.21.15.155:53614) 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 -- 172.21.15.155:0/2040864062 learned_addr learned my addr 172.21.15.155:0/2040864062 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:57.854 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec944a640 1 --2- 172.21.15.155:0/2040864062 >> v2:172.21.15.191:3300/0 conn(0x7feec4155170 0x7feec415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec8c49640 1 --2- 172.21.15.155:0/2040864062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec4155550 0x7feec40d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 -- 172.21.15.155:0/2040864062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec4155550 msgr2=0x7feec40d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:57.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 --2- 172.21.15.155:0/2040864062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec4155550 0x7feec40d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 -- 172.21.15.155:0/2040864062 >> v2:172.21.15.191:3300/0 conn(0x7feec4155170 msgr2=0x7feec415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:57.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 --2- 172.21.15.155:0/2040864062 >> v2:172.21.15.191:3300/0 conn(0x7feec4155170 0x7feec415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.853+0000 7feec9c4b640 1 -- 172.21.15.155:0/2040864062 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec40cd1e0 con 0x7feec40cb9e0 2024-04-25T13:17:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.854+0000 7feec9c4b640 1 --2- 172.21.15.155:0/2040864062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec40cb9e0 0x7feec40d0da0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feec4072ae0 tx=0x7feebc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22a3c133cf66e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.854+0000 7feebbfff640 1 -- 172.21.15.155:0/2040864062 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc036070 con 0x7feec40cb9e0 2024-04-25T13:17:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.854+0000 7feebbfff640 1 -- 172.21.15.155:0/2040864062 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feebc031600 con 0x7feec40cb9e0 2024-04-25T13:17:57.858 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.854+0000 7feebbfff640 1 -- 172.21.15.155:0/2040864062 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc0319f0 con 0x7feec40cb9e0 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 -- 172.21.15.155:0/2040864062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec40cb9e0 msgr2=0x7feec40d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 --2- 172.21.15.155:0/2040864062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec40cb9e0 0x7feec40d0da0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feec4072ae0 tx=0x7feebc02a610 comp rx=0 tx=0).stop 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 -- 172.21.15.155:0/2040864062 shutdown_connections 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 --2- 172.21.15.155:0/2040864062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec40cb9e0 0x7feec40d0da0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 --2- 172.21.15.155:0/2040864062 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec4155550 0x7feec40d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 --2- 172.21.15.155:0/2040864062 >> v2:172.21.15.191:3300/0 conn(0x7feec4155170 0x7feec415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 -- 172.21.15.155:0/2040864062 >> 172.21.15.155:0/2040864062 conn(0x7feec4072570 msgr2=0x7feec4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:57.859 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 -- 172.21.15.155:0/2040864062 shutdown_connections 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.855+0000 7feecb6ae640 1 -- 172.21.15.155:0/2040864062 wait complete. 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 Processor -- start 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 -- start start 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec40cb9e0 0x7feec414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 0x7feec414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4155550 0x7feec414b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feec40cda80 con 0x7feec4155170 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7feec40cd7a0 con 0x7feec4155550 2024-04-25T13:17:57.860 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.856+0000 7feecb6ae640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7feec40ccae0 con 0x7feec40cb9e0 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 0x7feec414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 0x7feec414d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53624/0 (socket says 172.21.15.155:53624) 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 -- 172.21.15.155:0/386511773 learned_addr learned my addr 172.21.15.155:0/386511773 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec944a640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec40cb9e0 0x7feec414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec9c4b640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4155550 0x7feec414b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 -- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec40cb9e0 msgr2=0x7feec414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec40cb9e0 0x7feec414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 -- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4155550 msgr2=0x7feec414b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:57.861 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4155550 0x7feec414b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 -- 172.21.15.155:0/386511773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec415d230 con 0x7feec4155170 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feec8c49640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 0x7feec414d820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feeb400d620 tx=0x7feeb400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb400b620 con 0x7feec4155170 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feeb4019070 con 0x7feec4155170 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb400ba20 con 0x7feec4155170 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec41f1420 con 0x7feec4155170 2024-04-25T13:17:57.862 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.857+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec414c4f0 con 0x7feec4155170 2024-04-25T13:17:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.859+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec4068e40 con 0x7feec4155170 2024-04-25T13:17:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.859+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feeb400bbc0 con 0x7feec4155170 2024-04-25T13:17:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.859+0000 7feeb9ffb640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feea806c8f0 0x7feea806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:57.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.859+0000 7feec944a640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feea806c8f0 0x7feea806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:57.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.859+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7feeb408c370 con 0x7feec4155170 2024-04-25T13:17:57.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.860+0000 7feec944a640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feea806c8f0 0x7feea806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feec0009ad0 tx=0x7feec0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:57.864 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:57.864+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feeb405a310 con 0x7feec4155170 2024-04-25T13:17:58.078 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.079+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feec40cc2b0 con 0x7feec4155170 2024-04-25T13:17:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.080+0000 7feeb9ffb640 1 -- 172.21.15.155:0/386511773 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7feeb4059c10 con 0x7feec4155170 2024-04-25T13:17:58.080 INFO:teuthology.orchestra.run.smithi155.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:17:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.084+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feea806c8f0 msgr2=0x7feea806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.084+0000 7feecb6ae640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feea806c8f0 0x7feea806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feec0009ad0 tx=0x7feec0008040 comp rx=0 tx=0).stop 2024-04-25T13:17:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.084+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 msgr2=0x7feec414d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.084+0000 7feecb6ae640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 0x7feec414d820 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feeb400d620 tx=0x7feeb400dae0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 shutdown_connections 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feec4155550 0x7feec414b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feec4155170 0x7feec414d820 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7feea806c8f0 0x7feea806edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 --2- 172.21.15.155:0/386511773 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7feec40cb9e0 0x7feec414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 >> 172.21.15.155:0/386511773 conn(0x7feec4072570 msgr2=0x7feec4154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 shutdown_connections 2024-04-25T13:17:58.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.085+0000 7feecb6ae640 1 -- 172.21.15.155:0/386511773 wait complete. 2024-04-25T13:17:58.089 INFO:tasks.ceph.mds.b.smithi191.stderr: -3981> 2024-04-25T13:16:36.134+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:17:58.090 INFO:tasks.ceph.mds.b.smithi191.stderr: -3137> 2024-04-25T13:16:56.135+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-25T13:17:58.090 INFO:tasks.ceph.mds.b.smithi191.stderr: -2831> 2024-04-25T13:17:01.135+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T13:17:58.091 INFO:tasks.ceph.mds.b.smithi191.stderr: -2507> 2024-04-25T13:17:06.136+0000 7fb598e13640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-25T13:17:58.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:17:58.115 INFO:tasks.ceph.mds.c.smithi155.stdout:starting mds.c at 2024-04-25T13:17:58.118 INFO:tasks.ceph.mds.d.smithi191.stdout:starting mds.d at 2024-04-25T13:17:58.120 INFO:tasks.ceph.mds.b.smithi191.stdout:starting mds.b at 2024-04-25T13:17:58.123 INFO:tasks.ceph.mds.e.smithi155.stdout:starting mds.e at 2024-04-25T13:17:58.124 INFO:tasks.ceph.mds.a.smithi155.stdout:starting mds.a at 2024-04-25T13:17:58.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.201+0000 7ff026cc2640 1 Processor -- start 2024-04-25T13:17:58.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff026cc2640 1 -- start start 2024-04-25T13:17:58.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff026cc2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0201595f0 0x7ff020159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:58.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff026cc2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff020159f80 con 0x7ff0200c8660 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff026cc2640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff02015b420 con 0x7ff020151fc0 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff026cc2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff02015b700 con 0x7ff0201595f0 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff01ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0201595f0 0x7ff020159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff01ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0201595f0 0x7ff020159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53672/0 (socket says 172.21.15.155:53672) 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff01ffff640 1 -- 172.21.15.155:0/1962632614 learned_addr learned my addr 172.21.15.155:0/1962632614 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.202+0000 7ff02525f640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7ff0200c8660 0x7ff0200c8a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54196/0 (socket says 172.21.15.155:54196) 2024-04-25T13:17:58.204 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.203+0000 7ff01ffff640 1 -- 172.21.15.155:0/1962632614 >> v1:172.21.15.191:6789/0 conn(0x7ff020151fc0 legacy=0x7ff0200c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.203+0000 7ff01ffff640 1 -- 172.21.15.155:0/1962632614 >> v1:172.21.15.155:6789/0 conn(0x7ff0200c8660 legacy=0x7ff0200c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.203+0000 7ff01ffff640 1 -- 172.21.15.155:0/1962632614 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff02015b9e0 con 0x7ff0201595f0 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.203+0000 7ff01f7fe640 1 -- 172.21.15.155:0/1962632614 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896674247 0 0) 0x7ff020159f80 con 0x7ff0200c8660 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.203+0000 7ff01ffff640 1 --2- 172.21.15.155:0/1962632614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0201595f0 0x7ff020159a40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009870 tx=0x7ff00c02a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701c6a8bf2be2bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff01f7fe640 1 -- 172.21.15.155:0/1962632614 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c037070 con 0x7ff0201595f0 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff01f7fe640 1 -- 172.21.15.155:0/1962632614 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff00c032640 con 0x7ff0201595f0 2024-04-25T13:17:58.205 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff01f7fe640 1 -- 172.21.15.155:0/1962632614 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c032a30 con 0x7ff0201595f0 2024-04-25T13:17:58.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 -- 172.21.15.155:0/1962632614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0201595f0 msgr2=0x7ff020159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 --2- 172.21.15.155:0/1962632614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0201595f0 0x7ff020159a40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009870 tx=0x7ff00c02a3c0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 -- 172.21.15.155:0/1962632614 shutdown_connections 2024-04-25T13:17:58.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 --2- 172.21.15.155:0/1962632614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0201595f0 0x7ff020159a40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.208 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 -- 172.21.15.155:0/1962632614 >> 172.21.15.155:0/1962632614 conn(0x7ff02006b920 msgr2=0x7ff02006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 -- 172.21.15.155:0/1962632614 shutdown_connections 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.204+0000 7ff026cc2640 1 -- 172.21.15.155:0/1962632614 wait complete. 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.205+0000 7ff026cc2640 1 Processor -- start 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.205+0000 7ff026cc2640 1 -- start start 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff026cc2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0200c8660 0x7ff0201f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff026cc2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 0x7ff02014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff026cc2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0201595f0 0x7ff0201475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff026cc2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff020158b80 con 0x7ff020151fc0 2024-04-25T13:17:58.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff026cc2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7ff02015bfa0 con 0x7ff0200c8660 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff026cc2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7ff0200c9180 con 0x7ff0201595f0 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 0x7ff02014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 0x7ff02014f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53688/0 (socket says 172.21.15.155:53688) 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 -- 172.21.15.155:0/302236069 learned_addr learned my addr 172.21.15.155:0/302236069 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff02525f640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0201595f0 0x7ff0201475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff024a5e640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0200c8660 0x7ff0201f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:58.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 -- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0201595f0 msgr2=0x7ff0201475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0201595f0 0x7ff0201475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 -- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0200c8660 msgr2=0x7ff0201f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0200c8660 0x7ff0201f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.206+0000 7ff01ffff640 1 -- 172.21.15.155:0/302236069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0201f2ec0 con 0x7ff020151fc0 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.207+0000 7ff01ffff640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 0x7ff02014f7b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009870 tx=0x7ff00c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.207+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c041020 con 0x7ff020151fc0 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.207+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff00c030970 con 0x7ff020151fc0 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.207+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0200cdec0 con 0x7ff020151fc0 2024-04-25T13:17:58.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.207+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c037040 con 0x7ff020151fc0 2024-04-25T13:17:58.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.207+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0200ce160 con 0x7ff020151fc0 2024-04-25T13:17:58.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.208+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff020068f50 con 0x7ff020151fc0 2024-04-25T13:17:58.212 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.208+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff00c044020 con 0x7ff020151fc0 2024-04-25T13:17:58.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.208+0000 7ff01d7fa640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff00406c8f0 0x7ff00406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:58.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.209+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 7165+0+0 (secure 0 0 0) 0x7ff00c0accd0 con 0x7ff020151fc0 2024-04-25T13:17:58.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.209+0000 7ff024a5e640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff00406c8f0 0x7ff00406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:58.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.209+0000 7ff024a5e640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff00406c8f0 0x7ff00406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff014000f60 tx=0x7ff014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:58.213 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.213+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff00c04b030 con 0x7ff020151fc0 2024-04-25T13:17:58.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:58.423+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff0200c99c0 con 0x7ff020151fc0 2024-04-25T13:17:59.082 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.082+0000 7ff01d7fa640 1 -- 172.21.15.155:0/302236069 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7ff00c07aac0 con 0x7ff020151fc0 2024-04-25T13:17:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.084+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff00406c8f0 msgr2=0x7ff00406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.084+0000 7ff026cc2640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff00406c8f0 0x7ff00406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff014000f60 tx=0x7ff014009040 comp rx=0 tx=0).stop 2024-04-25T13:17:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.084+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 msgr2=0x7ff02014f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.084+0000 7ff026cc2640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 0x7ff02014f7b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009870 tx=0x7ff00c0046c0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.085 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.084+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 shutdown_connections 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.084+0000 7ff026cc2640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7ff00406c8f0 0x7ff00406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.085+0000 7ff026cc2640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7ff0201595f0 0x7ff0201475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.085+0000 7ff026cc2640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff020151fc0 0x7ff02014f7b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.085+0000 7ff026cc2640 1 --2- 172.21.15.155:0/302236069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff0200c8660 0x7ff0201f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.085+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 >> 172.21.15.155:0/302236069 conn(0x7ff02006b920 msgr2=0x7ff02015a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.085+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 shutdown_connections 2024-04-25T13:17:59.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.085+0000 7ff026cc2640 1 -- 172.21.15.155:0/302236069 wait complete. 2024-04-25T13:17:59.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:17:59.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.241+0000 7f557a9ef640 1 Processor -- start 2024-04-25T13:17:59.241 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.241+0000 7f557a9ef640 1 -- start start 2024-04-25T13:17:59.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f557a9ef640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 0x7f55740c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f557a9ef640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740c20a0 con 0x7f55740c7a70 2024-04-25T13:17:59.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f557a9ef640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55740c2380 con 0x7f55740c9dc0 2024-04-25T13:17:59.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f557a9ef640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f55740c8350 con 0x7f55740b1e40 2024-04-25T13:17:59.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f55737fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f55740c7a70 0x7f5574163a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54204/0 (socket says 172.21.15.155:54204) 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f55737fe640 1 -- 172.21.15.155:0/516587375 learned_addr learned my addr 172.21.15.155:0/516587375 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f5578f8c640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 0x7f55740c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283822616 0 0) 0x7f55740c20a0 con 0x7f55740c7a70 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.242+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f555c003520 con 0x7f55740c7a70 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 <== mon.0 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 213101629 0 0) 0x7f555c003520 con 0x7f55740c7a70 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 msgr2=0x7f55740c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 0x7f55740c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 >> v1:172.21.15.191:6789/0 conn(0x7f55740c9dc0 legacy=0x7f55740c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55740c2660 con 0x7f55740c7a70 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 <== mon.0 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3902787442 0 0) 0x7f5568001690 con 0x7f55740c7a70 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 >> v1:172.21.15.155:6789/0 conn(0x7f55740c7a70 legacy=0x7f5574163a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f555c0039e0 0x7f555c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f555c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 0x7f555c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f555c00bb00 con 0x7f555c004800 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f555c00bcb0 con 0x7f555c0039e0 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f555c00beb0 con 0x7f55740b1e40 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f55737fe640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f555c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5573fff640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f555c0039e0 0x7f555c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f5578f8c640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 0x7f555c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f55737fe640 1 -- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 msgr2=0x7f555c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f55737fe640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740b1e40 0x7f555c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f55737fe640 1 -- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f555c0039e0 msgr2=0x7f555c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:17:59.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f55737fe640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f555c0039e0 0x7f555c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.243+0000 7f55737fe640 1 -- 172.21.15.155:0/516587375 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c003520 con 0x7f555c004800 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.244+0000 7f55737fe640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f555c004c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f55740745c0 tx=0x7f555c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a93f9a60787d18d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.244+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568007d30 con 0x7f555c004800 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.244+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5568005af0 con 0x7f555c004800 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.244+0000 7f5572ffd640 1 -- 172.21.15.155:0/516587375 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568007070 con 0x7f555c004800 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.244+0000 7f557a9ef640 1 -- 172.21.15.155:0/516587375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 msgr2=0x7f555c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.244+0000 7f557a9ef640 1 --2- 172.21.15.155:0/516587375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f555c004c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f55740745c0 tx=0x7f555c005830 comp rx=0 tx=0).stop 2024-04-25T13:17:59.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.245+0000 7f5578f8c640 1 -- 172.21.15.155:0/516587375 reap_dead start 2024-04-25T13:17:59.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.245+0000 7f557a9ef640 1 -- 172.21.15.155:0/516587375 shutdown_connections 2024-04-25T13:17:59.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.245+0000 7f557a9ef640 1 -- 172.21.15.155:0/516587375 >> 172.21.15.155:0/516587375 conn(0x7f5574075170 msgr2=0x7f557406db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:17:59.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.245+0000 7f557a9ef640 1 -- 172.21.15.155:0/516587375 shutdown_connections 2024-04-25T13:17:59.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.245+0000 7f557a9ef640 1 -- 172.21.15.155:0/516587375 wait complete. 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.246+0000 7f557a9ef640 1 Processor -- start 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.246+0000 7f557a9ef640 1 -- start start 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f5574156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55741f5320 0x7f5574151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740c6c40 0x7f5574149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55740b2480 con 0x7f555c004800 2024-04-25T13:17:59.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f55741556a0 con 0x7f55741f5320 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f5574155820 con 0x7f55740c6c40 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f5574156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f5574156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53702/0 (socket says 172.21.15.155:53702) 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 -- 172.21.15.155:0/896683543 learned_addr learned my addr 172.21.15.155:0/896683543 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 -- 172.21.15.155:0/896683543 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740c6c40 msgr2=0x7f5574149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740c6c40 0x7f5574149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 -- 172.21.15.155:0/896683543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55741f5320 msgr2=0x7f5574151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55741f5320 0x7f5574151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 -- 172.21.15.155:0/896683543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55740c4f30 con 0x7f555c004800 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5573fff640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f5574156530 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f556400f5f0 tx=0x7f556400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55640052e0 con 0x7f555c004800 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5564018070 con 0x7f555c004800 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564003830 con 0x7f555c004800 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55740c5210 con 0x7f555c004800 2024-04-25T13:17:59.255 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.247+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55741f4b20 con 0x7f555c004800 2024-04-25T13:17:59.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.248+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55741f5740 con 0x7f555c004800 2024-04-25T13:17:59.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.249+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55640039d0 con 0x7f555c004800 2024-04-25T13:17:59.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.249+0000 7f5570ff9640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f556006c920 0x7f556006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:17:59.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.249+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 7165+0+0 (secure 0 0 0) 0x7f556408bfd0 con 0x7f555c004800 2024-04-25T13:17:59.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.249+0000 7f55737fe640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f556006c920 0x7f556006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:17:59.256 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.250+0000 7f55737fe640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f556006c920 0x7f556006ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5568032000 tx=0x7f5568009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:17:59.257 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.253+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5564059dc0 con 0x7f555c004800 2024-04-25T13:17:59.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:17:59.427+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5574069eb0 con 0x7f555c004800 2024-04-25T13:18:00.087 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.086+0000 7f5570ff9640 1 -- 172.21.15.155:0/896683543 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f55640596c0 con 0x7f555c004800 2024-04-25T13:18:00.087 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:18:00.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f556006c920 msgr2=0x7f556006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:00.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f556006c920 0x7f556006ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5568032000 tx=0x7f5568009030 comp rx=0 tx=0).stop 2024-04-25T13:18:00.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 msgr2=0x7f5574156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:00.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f5574156530 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f556400f5f0 tx=0x7f556400fab0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 shutdown_connections 2024-04-25T13:18:00.090 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f556006c920 0x7f556006ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f55740c6c40 0x7f5574149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55741f5320 0x7f5574151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 --2- 172.21.15.155:0/896683543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f555c004800 0x7f5574156530 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.089+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 >> 172.21.15.155:0/896683543 conn(0x7f5574075170 msgr2=0x7f55740ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:00.091 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.090+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 shutdown_connections 2024-04-25T13:18:00.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.093+0000 7f557a9ef640 1 -- 172.21.15.155:0/896683543 wait complete. 2024-04-25T13:18:00.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:18:00.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.209+0000 7f14d55e2640 1 Processor -- start 2024-04-25T13:18:00.209 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.209+0000 7f14d55e2640 1 -- start start 2024-04-25T13:18:00.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.209+0000 7f14d55e2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14d0155130 0x7f14d015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:00.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14d55e2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d00cde80 0x7f14d00c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:00.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14d55e2640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d015e800 con 0x7f14d0155510 2024-04-25T13:18:00.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14d55e2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f14d015e5d0 con 0x7f14d0155130 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14d55e2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f14d015bfa0 con 0x7f14d00cde80 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14d0155130 0x7f14d015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f14d0155130 0x7f14d015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53716/0 (socket says 172.21.15.155:53716) 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 -- 172.21.15.155:0/3103665279 learned_addr learned my addr 172.21.15.155:0/3103665279 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14cf7fe640 1 --2- 172.21.15.155:0/3103665279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d00cde80 0x7f14d00c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 -- 172.21.15.155:0/3103665279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d00cde80 msgr2=0x7f14d00c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 --2- 172.21.15.155:0/3103665279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d00cde80 0x7f14d00c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 -- 172.21.15.155:0/3103665279 >> v1:172.21.15.191:6789/0 conn(0x7f14d0155510 legacy=0x7f14d0073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:00.211 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.210+0000 7f14ceffd640 1 -- 172.21.15.155:0/3103665279 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d015eac0 con 0x7f14d0155130 2024-04-25T13:18:00.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14ceffd640 1 --2- 172.21.15.155:0/3103665279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0155130 0x7f14d015ba60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f14c00098a0 tx=0x7f14c002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497d8578f996d1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:00.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14cdffb640 1 -- 172.21.15.155:0/3103665279 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0037070 con 0x7f14d0155130 2024-04-25T13:18:00.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14cdffb640 1 -- 172.21.15.155:0/3103665279 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f14c0032440 con 0x7f14d0155130 2024-04-25T13:18:00.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14cdffb640 1 -- 172.21.15.155:0/3103665279 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0032830 con 0x7f14d0155130 2024-04-25T13:18:00.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 -- 172.21.15.155:0/3103665279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0155130 msgr2=0x7f14d015ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:00.215 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3103665279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0155130 0x7f14d015ba60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f14c00098a0 tx=0x7f14c002a290 comp rx=0 tx=0).stop 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 -- 172.21.15.155:0/3103665279 shutdown_connections 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3103665279 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d00cde80 0x7f14d00c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3103665279 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d0155130 0x7f14d015ba60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 -- 172.21.15.155:0/3103665279 >> 172.21.15.155:0/3103665279 conn(0x7f14d0068360 msgr2=0x7f14d006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 -- 172.21.15.155:0/3103665279 shutdown_connections 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.211+0000 7f14d55e2640 1 -- 172.21.15.155:0/3103665279 wait complete. 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 Processor -- start 2024-04-25T13:18:00.216 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 -- start start 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 0x7f14d014ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14d0155130 0x7f14d01455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d0155510 0x7f14d014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f14d015f080 con 0x7f14d00cde80 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00c57a0 con 0x7f14d0155130 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14d55e2640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f14d015f360 con 0x7f14d0155510 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14ceffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 0x7f14d014ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14ceffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 0x7f14d014ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53730/0 (socket says 172.21.15.155:53730) 2024-04-25T13:18:00.217 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.213+0000 7f14ceffd640 1 -- 172.21.15.155:0/3892688097 learned_addr learned my addr 172.21.15.155:0/3892688097 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14cf7fe640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d0155510 0x7f14d014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ce7fc640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14d0155130 0x7f14d01455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ceffd640 1 -- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d0155510 msgr2=0x7f14d014de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ceffd640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d0155510 0x7f14d014de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ceffd640 1 -- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14d0155130 msgr2=0x7f14d01455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ceffd640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14d0155130 0x7f14d01455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ceffd640 1 -- 172.21.15.155:0/3892688097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d01e4f20 con 0x7f14d00cde80 2024-04-25T13:18:00.218 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ce7fc640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14d0155130 0x7f14d01455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14ceffd640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 0x7f14d014ac20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14c00098a0 tx=0x7f14c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0037040 con 0x7f14d00cde80 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f14c0042070 con 0x7f14d00cde80 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0030920 con 0x7f14d00cde80 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d01f5450 con 0x7f14d00cde80 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.214+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d01f48d0 con 0x7f14d00cde80 2024-04-25T13:18:00.219 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.215+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d015c230 con 0x7f14d00cde80 2024-04-25T13:18:00.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.216+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14c0030ac0 con 0x7f14d00cde80 2024-04-25T13:18:00.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.216+0000 7f14b77fe640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f14bc06c920 0x7f14bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:00.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.216+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6727+0+0 (secure 0 0 0) 0x7f14c00ac750 con 0x7f14d00cde80 2024-04-25T13:18:00.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.216+0000 7f14ce7fc640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f14bc06c920 0x7f14bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:00.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.216+0000 7f14ce7fc640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f14bc06c920 0x7f14bc06ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14d0158ba0 tx=0x7f14c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:00.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.220+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14d01e4f20 con 0x7f14d00cde80 2024-04-25T13:18:00.395 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:00.395+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f14d00cad50 con 0x7f14d00cde80 2024-04-25T13:18:01.093 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.093+0000 7f14b77fe640 1 -- 172.21.15.155:0/3892688097 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f14c007a780 con 0x7f14d00cde80 2024-04-25T13:18:01.093 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data' removed 2024-04-25T13:18:01.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.100+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f14bc06c920 msgr2=0x7f14bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:01.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.100+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f14bc06c920 0x7f14bc06ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f14d0158ba0 tx=0x7f14c4009040 comp rx=0 tx=0).stop 2024-04-25T13:18:01.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.100+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 msgr2=0x7f14d014ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:01.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.100+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 0x7f14d014ac20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f14c00098a0 tx=0x7f14c00046c0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.101+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 shutdown_connections 2024-04-25T13:18:01.102 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.101+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f14bc06c920 0x7f14bc06ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.101+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f14d0155510 0x7f14d014de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.101+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f14d0155130 0x7f14d01455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.101+0000 7f14d55e2640 1 --2- 172.21.15.155:0/3892688097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14d00cde80 0x7f14d014ac20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.101+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 >> 172.21.15.155:0/3892688097 conn(0x7f14d0068360 msgr2=0x7f14d00ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:01.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.102+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 shutdown_connections 2024-04-25T13:18:01.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.102+0000 7f14d55e2640 1 -- 172.21.15.155:0/3892688097 wait complete. 2024-04-25T13:18:01.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T13:18:01.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.220+0000 7f9caec2c640 1 Processor -- start 2024-04-25T13:18:01.220 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.220+0000 7f9caec2c640 1 -- start start 2024-04-25T13:18:01.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9caec2c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ca8152ea0 0x7f9ca8159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:01.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9caec2c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca8153280 con 0x7f9ca8159a80 2024-04-25T13:18:01.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9caec2c640 1 -- --> v1:172.21.15.191:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca806f560 con 0x7f9ca80c79e0 2024-04-25T13:18:01.222 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9caec2c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca8074600 con 0x7f9ca8152ea0 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9cac9c8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ca8152ea0 0x7f9ca8159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9cad1c9640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f9ca8159a80 0x7f9ca8163800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:54218/0 (socket says 172.21.15.155:54218) 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9cad1c9640 1 -- 172.21.15.155:0/951154482 learned_addr learned my addr 172.21.15.155:0/951154482 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9cac9c8640 1 -- 172.21.15.155:0/951154482 >> v1:172.21.15.191:6789/0 conn(0x7f9ca80c79e0 legacy=0x7f9ca80719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9cac9c8640 1 -- 172.21.15.155:0/951154482 >> v1:172.21.15.155:6789/0 conn(0x7f9ca8159a80 legacy=0x7f9ca8163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9cac9c8640 1 -- 172.21.15.155:0/951154482 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca806f840 con 0x7f9ca8152ea0 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.221+0000 7f9c9f7fe640 1 -- 172.21.15.155:0/951154482 <== mon.0 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455069090 0 0) 0x7f9ca8153280 con 0x7f9ca8159a80 2024-04-25T13:18:01.223 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.222+0000 7f9cac9c8640 1 --2- 172.21.15.155:0/951154482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8152ea0 0x7f9ca8159540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40097a0 tx=0x7f9ca402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd367f9d9543e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.222+0000 7f9c9f7fe640 1 -- 172.21.15.155:0/951154482 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4037070 con 0x7f9ca8152ea0 2024-04-25T13:18:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.222+0000 7f9c9f7fe640 1 -- 172.21.15.155:0/951154482 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ca4032440 con 0x7f9ca8152ea0 2024-04-25T13:18:01.224 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.222+0000 7f9c9f7fe640 1 -- 172.21.15.155:0/951154482 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4032830 con 0x7f9ca8152ea0 2024-04-25T13:18:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.222+0000 7f9caec2c640 1 -- 172.21.15.155:0/951154482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8152ea0 msgr2=0x7f9ca8159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.222+0000 7f9caec2c640 1 --2- 172.21.15.155:0/951154482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8152ea0 0x7f9ca8159540 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40097a0 tx=0x7f9ca402a1e0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.223+0000 7f9caec2c640 1 -- 172.21.15.155:0/951154482 shutdown_connections 2024-04-25T13:18:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.223+0000 7f9caec2c640 1 --2- 172.21.15.155:0/951154482 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8152ea0 0x7f9ca8159540 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.223+0000 7f9caec2c640 1 -- 172.21.15.155:0/951154482 >> 172.21.15.155:0/951154482 conn(0x7f9ca8075170 msgr2=0x7f9ca806db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:01.227 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.223+0000 7f9caec2c640 1 -- 172.21.15.155:0/951154482 shutdown_connections 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.223+0000 7f9caec2c640 1 -- 172.21.15.155:0/951154482 wait complete. 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.224+0000 7f9caec2c640 1 Processor -- start 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.224+0000 7f9caec2c640 1 -- start start 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.224+0000 7f9caec2c640 1 --2- >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ca80c79e0 0x7f9ca8149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ca8152ea0 0x7f9ca815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 0x7f9ca814f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8159020 con 0x7f9ca8159a80 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca806fe00 con 0x7f9ca8152ea0 2024-04-25T13:18:01.228 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 -- --> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca80742c0 con 0x7f9ca80c79e0 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 0x7f9ca814f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 0x7f9ca814f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:53750/0 (socket says 172.21.15.155:53750) 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 -- 172.21.15.155:0/1158830875 learned_addr learned my addr 172.21.15.155:0/1158830875 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cac9c8640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ca80c79e0 0x7f9ca8149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9c9ffff640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ca8152ea0 0x7f9ca815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 -- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ca80c79e0 msgr2=0x7f9ca8149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ca80c79e0 0x7f9ca8149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.229 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 -- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ca8152ea0 msgr2=0x7f9ca815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ca8152ea0 0x7f9ca815c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 -- 172.21.15.155:0/1158830875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca80cdd30 con 0x7f9ca8159a80 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9cad1c9640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 0x7f9ca814f4d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c7d0 tx=0x7f9ca000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0018070 con 0x7f9ca8159a80 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ca000a640 con 0x7f9ca8159a80 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca80cda50 con 0x7f9ca8159a80 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca000aa90 con 0x7f9ca8159a80 2024-04-25T13:18:01.230 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.225+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca80cb950 con 0x7f9ca8159a80 2024-04-25T13:18:01.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.226+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca8069eb0 con 0x7f9ca8159a80 2024-04-25T13:18:01.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.227+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ca001b070 con 0x7f9ca8159a80 2024-04-25T13:18:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.227+0000 7f9c9d7fa640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f9c9406c8f0 0x7f9c9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:18:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.227+0000 7f9cac9c8640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f9c9406c8f0 0x7f9c9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:18:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.227+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6197+0+0 (secure 0 0 0) 0x7f9ca008b3b0 con 0x7f9ca8159a80 2024-04-25T13:18:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.228+0000 7f9cac9c8640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f9c9406c8f0 0x7f9c9406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4034000 tx=0x7f9ca402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:18:01.232 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.232+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ca0059560 con 0x7f9ca8159a80 2024-04-25T13:18:01.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:01.405+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9ca80ca7e0 con 0x7f9ca8159a80 2024-04-25T13:18:02.099 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.098+0000 7f9c9d7fa640 1 -- 172.21.15.155:0/1158830875 <== mon.0 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f9ca0058e60 con 0x7f9ca8159a80 2024-04-25T13:18:02.099 INFO:teuthology.orchestra.run.smithi155.stderr:pool 'cephfs_data_ec' removed 2024-04-25T13:18:02.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f9c9406c8f0 msgr2=0x7f9c9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f9c9406c8f0 0x7f9c9406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4034000 tx=0x7f9ca402e000 comp rx=0 tx=0).stop 2024-04-25T13:18:02.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 msgr2=0x7f9ca814f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:18:02.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 0x7f9ca814f4d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c7d0 tx=0x7f9ca000cc90 comp rx=0 tx=0).stop 2024-04-25T13:18:02.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 shutdown_connections 2024-04-25T13:18:02.103 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca8159a80 0x7f9ca814f4d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ca8152ea0 0x7f9ca815c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.155:6832/235379904,v1:172.21.15.155:6833/235379904] conn(0x7f9c9406c8f0 0x7f9c9406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 --2- 172.21.15.155:0/1158830875 >> [v2:172.21.15.191:3301/0,v1:172.21.15.191:6790/0] conn(0x7f9ca80c79e0 0x7f9ca8149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:18:02.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.102+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 >> 172.21.15.155:0/1158830875 conn(0x7f9ca8075170 msgr2=0x7f9ca80c8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:18:02.104 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.103+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 shutdown_connections 2024-04-25T13:18:02.105 INFO:teuthology.orchestra.run.smithi155.stderr:2024-04-25T13:18:02.104+0000 7f9caec2c640 1 -- 172.21.15.155:0/1158830875 wait complete. 2024-04-25T13:18:02.119 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T13:18:02.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T13:18:02.120 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.129 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T13:18:02.130 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T13:18:02.130 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.180 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T13:18:02.180 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T13:18:02.180 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.229 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T13:18:02.230 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T13:18:02.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.241 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T13:18:02.241 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T13:18:02.242 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.293 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T13:18:02.293 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T13:18:02.293 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.343 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T13:18:02.343 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T13:18:02.344 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T13:18:02.344 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.373 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T13:18:02.373 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T13:18:02.374 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.444 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T13:18:02.445 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T13:18:02.445 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.508 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T13:18:02.508 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T13:18:02.508 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-25T13:18:02.574 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T13:18:02.574 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T13:18:02.574 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.598 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T13:18:02.598 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T13:18:02.599 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.669 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T13:18:02.669 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T13:18:02.669 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.738 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T13:18:02.738 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T13:18:02.738 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.808 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T13:18:02.808 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T13:18:02.809 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T13:18:02.809 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.835 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T13:18:02.836 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T13:18:02.836 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.873 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T13:18:02.873 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T13:18:02.873 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T13:18:02.873 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.887 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T13:18:02.887 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T13:18:02.888 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.924 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T13:18:02.924 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T13:18:02.924 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:18:02.975 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T13:18:02.975 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T13:18:02.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T13:18:03.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:18:03.013 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T13:18:03.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:18:03.307 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T13:18:03.378 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:18:03.378 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T13:18:03.435 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:18:03.435 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T13:18:03.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:18:03.485 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T13:18:03.819 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:18:03.819 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T13:18:03.877 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:18:03.877 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T13:18:03.935 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:18:03.935 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T13:18:03.983 INFO:tasks.ceph:Archiving mon data... 2024-04-25T13:18:03.984 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/data/mon.a.tgz 2024-04-25T13:18:03.984 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-04-25T13:18:03.999 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.P8E9A50c4O 2024-04-25T13:18:04.000 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.P8E9A50c4O 2024-04-25T13:18:04.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.P8E9A50c4O 2024-04-25T13:18:04.216 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.P8E9A50c4O is 282KB 2024-04-25T13:18:04.311 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.P8E9A50c4O 2024-04-25T13:18:04.326 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/data/mon.b.tgz 2024-04-25T13:18:04.326 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-25T13:18:04.342 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.ldNZCrBkw1 2024-04-25T13:18:04.342 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ldNZCrBkw1 2024-04-25T13:18:04.490 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.ldNZCrBkw1 2024-04-25T13:18:04.572 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.ldNZCrBkw1 is 384KB 2024-04-25T13:18:04.666 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.ldNZCrBkw1 2024-04-25T13:18:04.681 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/data/mon.c.tgz 2024-04-25T13:18:04.681 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2024-04-25T13:18:04.735 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.vfFE4Dw1eh 2024-04-25T13:18:04.735 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vfFE4Dw1eh 2024-04-25T13:18:04.867 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.vfFE4Dw1eh 2024-04-25T13:18:04.948 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.vfFE4Dw1eh is 384KB 2024-04-25T13:18:05.043 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.vfFE4Dw1eh 2024-04-25T13:18:05.057 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T13:18:05.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:18:05.060 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:18:05.139 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:18:05.174 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:18:05.175 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T13:18:05.176 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/remote/smithi155/crash 2024-04-25T13:18:05.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:18:05.204 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/remote/smithi191/crash 2024-04-25T13:18:05.205 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:18:05.237 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T13:18:05.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:05.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:05.324 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:05.348 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:18:05.387 INFO:tasks.ceph:Compressing logs... 2024-04-25T13:18:05.387 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:18:05.391 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:18:05.412 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44243.log 2024-04-25T13:18:05.412 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-04-25T13:18:05.457 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46808.log 2024-04-25T13:18:05.458 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44243.log.gz 2024-04-25T13:18:05.458 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-04-25T13:18:05.458 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46808.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gzgzip 2024-04-25T13:18:05.458 INFO:teuthology.orchestra.run.smithi155.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41732.log 2024-04-25T13:18:05.458 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43751.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46808.log.gz 2024-04-25T13:18:05.458 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5/var/log/ceph/ceph-client.admin.41732.log: --verbose -- /var/log/ceph/ceph-client.admin.42745.log 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48067.log 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41732.log.gz 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42745.log.gz 2024-04-25T13:18:05.459 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.48067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44599.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48067.log.gz 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44557.log 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47032.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43926.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44557.log.gz 2024-04-25T13:18:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43499.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44998.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2024-04-25T13:18:05.461 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44650.log 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44245.log 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42661.log 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44650.log.gz 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:18:05.462 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42661.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44245.log.gz 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34715.log 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42661.log.gz 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34715.log.gz 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47746.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T13:18:05.463 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44872.log 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43930.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-04-25T13:18:05.464 INFO:teuthology.orchestra.run.smithi155.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44746.log 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-04-25T13:18:05.465 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44746.log.gz 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41520.log 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47074.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43278.log 2024-04-25T13:18:05.466 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41690.log 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41520.log: /var/log/ceph/ceph-client.admin.43278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41520.log.gz 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43278.log.gz 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44238.log 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41858.log 2024-04-25T13:18:05.467 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41690.log.gz 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44830.log 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44238.log.gz 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41858.log.gz 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44830.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43457.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44830.log.gz 2024-04-25T13:18:05.468 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46456.log 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.3.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41220.log 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47200.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46456.log.gz 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41264.log 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41220.log.gz 2024-04-25T13:18:05.469 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46184.log 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41264.log.gz 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43235.log: /var/log/ceph/ceph-client.admin.46682.log 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.0.46184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46682.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46682.log.gz 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44473.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28321.log 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.c.log: 89.5% -- replaced with /var/log/ceph/ceph-client.0.46184.log.gz 2024-04-25T13:18:05.470 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.tmp-client.admin.28321.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28321.log.gz 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47704.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44788.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2024-04-25T13:18:05.471 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.46990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42971.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43932.log 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45533.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45314.log 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43932.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-04-25T13:18:05.472 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43932.log.gz 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47620.log 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41604.log 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45314.log.gz 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46414.log 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41604.log: /var/log/ceph/ceph-client.admin.47620.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47620.log.gz 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41604.log.gz 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-04-25T13:18:05.473 INFO:teuthology.orchestra.run.smithi155.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46414.log.gz 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.48293.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47788.log 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47494.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47788.log.gz 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-04-25T13:18:05.474 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41178.log 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48251.log 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45128.log 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9%/var/log/ceph/ceph-client.admin.48251.log: -- replaced with /var/log/ceph/ceph-client.admin.41178.log.gz 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45356.log 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48251.log.gz 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45128.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45128.log.gz 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-04-25T13:18:05.475 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45356.log: /var/log/ceph/ceph-client.admin.42008.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45356.log.gz 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42829.log 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41306.log 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.42829.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42829.log.gz 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43373.log 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41306.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41306.log.gz 2024-04-25T13:18:05.476 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34351.log 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47242.log 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.34351.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43373.log.gz 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47536.log 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.34351.log.gz/var/log/ceph/ceph-client.admin.47242.log: 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47242.log.gz 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46498.log 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46498.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47536.log.gz 2024-04-25T13:18:05.477 INFO:teuthology.orchestra.run.smithi155.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46498.log.gz 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47116.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42929.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45665.log 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43320.log 2024-04-25T13:18:05.478 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45665.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44247.log 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43320.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45665.log.gz 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43320.log.gz 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45170.log 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47158.log 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44247.log: /var/log/ceph/ceph-client.admin.45170.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45170.log.gz 2024-04-25T13:18:05.479 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41562.log 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47158.log: /var/log/ceph/ceph-client.admin.44246.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47158.log.gz 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41562.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41562.log.gz 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-04-25T13:18:05.480 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41774.log: /var/log/ceph/ceph-client.admin.40963.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41390.log 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44235.log: /var/log/ceph/ceph-client.admin.47368.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41390.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41390.log.gz 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T13:18:05.481 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45793.log: /var/log/ceph/ceph-mds.e.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2024-04-25T13:18:05.482 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46850.log 2024-04-25T13:18:05.500 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34627.log 2024-04-25T13:18:05.500 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:18:05.500 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34747.log 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34627.log.gz 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34747.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mds.f.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34747.log.gz 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34496.log 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T13:18:05.501 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34496.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34496.log.gz 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.5.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34536.log 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T13:18:05.502 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.34536.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34536.log.gz 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34667.log 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34667.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34667.log.gz 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34456.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2024-04-25T13:18:05.503 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mds.d.log: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34707.log 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34580.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34707.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34707.log.gz 2024-04-25T13:18:05.504 INFO:teuthology.orchestra.run.smithi191.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T13:18:05.517 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44239.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2024-04-25T13:18:05.517 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42703.log 2024-04-25T13:18:05.517 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46850.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46850.log.gz 2024-04-25T13:18:05.517 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48025.log 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.42703.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42703.log.gz 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41432.log 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.48025.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48025.log.gz 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41432.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41432.log.gz 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41648.log 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41900.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-04-25T13:18:05.518 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41078.log 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41648.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41648.log.gz 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41816.log 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41078.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41078.log.gz 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44956.log 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41816.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41816.log.gz 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40853.log 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44956.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44956.log.gz 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-04-25T13:18:05.519 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.40853.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40853.log.gz 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47976.log 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43709.log: /var/log/ceph/ceph-client.admin.43055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46540.log 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47976.log: /var/log/ceph/ceph-client.admin.44409.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47976.log.gz 2024-04-25T13:18:05.520 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46582.log 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46540.log: /var/log/ceph/ceph-client.admin.46582.log: 90.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46540.log.gz 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46582.log.gz 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42436.log 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41476.log 2024-04-25T13:18:05.521 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43541.log: /var/log/ceph/ceph-client.admin.42436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.41476.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41476.log.gz 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2%/var/log/ceph/ceph-client.admin.43583.log: -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 92.1% -- replaced with /var/log/ceph/ceph-client.admin.42436.log.gz 2024-04-25T13:18:05.522 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45040.log: 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47662.log 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43097.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41348.log 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47662.log.gz 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48335.log 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.41348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.48335.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41348.log.gz 2024-04-25T13:18:05.523 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47931.log 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48335.log.gz 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45599.log 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz/var/log/ceph/ceph-client.admin.47931.log: 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47931.log.gz 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43931.log: 91.1% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45599.log.gz 2024-04-25T13:18:05.524 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47410.log 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48110.log 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47410.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47410.log.gz 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46724.log 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.48110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.46724.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48110.log.gz 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46724.log.gz 2024-04-25T13:18:05.525 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47452.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.44696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.48206.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2024-04-25T13:18:05.526 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43415.log 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47284.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47890.log 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47326.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43415.log.gz 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43929.log 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.47890.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47890.log.gz 2024-04-25T13:18:05.527 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.43929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46372.log 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45467.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43929.log.gz 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45398.log 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr: 91.0%/var/log/ceph/ceph-client.admin.46372.log: -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46372.log.gz 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.45398.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45398.log.gz 2024-04-25T13:18:05.528 INFO:teuthology.orchestra.run.smithi155.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T13:18:05.532 INFO:teuthology.orchestra.run.smithi191.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T13:18:05.544 INFO:teuthology.orchestra.run.smithi191.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T13:18:05.654 INFO:teuthology.orchestra.run.smithi155.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T13:18:05.983 INFO:teuthology.orchestra.run.smithi155.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T13:18:06.044 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T13:18:06.051 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T13:18:06.061 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T13:18:06.084 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T13:18:06.093 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T13:18:06.113 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T13:18:06.115 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-04-25T13:18:06.115 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m0.712s 2024-04-25T13:18:06.116 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m2.735s 2024-04-25T13:18:06.116 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.209s 2024-04-25T13:18:06.158 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T13:18:06.160 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-25T13:18:06.161 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m0.713s 2024-04-25T13:18:06.161 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m2.652s 2024-04-25T13:18:06.161 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.124s 2024-04-25T13:18:06.161 INFO:tasks.ceph:Archiving logs... 2024-04-25T13:18:06.161 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/remote/smithi155/log 2024-04-25T13:18:06.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:18:06.687 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/remote/smithi191/log 2024-04-25T13:18:06.688 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:18:07.083 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T13:18:07.092 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T13:18:07.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:18:07.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:18:07.172 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T13:18:07.183 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T13:18:07.184 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:18:07.189 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:18:07.198 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:18:07.202 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:18:07.202 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-04-25T13:18:07.203 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 +928us[ +923us] +/- 49ms 2024-04-25T13:18:07.203 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 -1526us[-1531us] +/- 56ms 2024-04-25T13:18:07.203 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +512us[ +508us] +/- 65ms 2024-04-25T13:18:07.203 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:18:07.203 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-25T13:18:07.207 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T13:18:07.207 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-25T13:18:07.208 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +925us[ +933us] +/- 49ms 2024-04-25T13:18:07.208 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 -1516us[-1508us] +/- 56ms 2024-04-25T13:18:07.208 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +513us[ +513us] +/- 65ms 2024-04-25T13:18:07.208 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T13:18:07.209 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T13:18:07.220 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T13:18:07.220 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T13:18:07.234 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:18:07.304 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T13:18:07.361 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:18:07.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:07.388 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T13:18:07.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:07.414 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T13:18:07.427 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T13:18:07.438 INFO:teuthology.task.internal:Duration was 506.715817 seconds 2024-04-25T13:18:07.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T13:18:07.452 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T13:18:07.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:18:07.455 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:18:07.489 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:18:07.491 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T13:18:07.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-25T13:18:07.718 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T13:18:07.718 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-04-25T13:18:07.719 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:18:07.778 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-04-25T13:18:07.778 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:18:07.800 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T13:18:07.801 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:18:07.821 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:18:07.866 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T13:18:07.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:18:07.886 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:18:07.998 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T13:18:08.010 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T13:18:08.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:18:08.034 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:18:08.058 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T13:18:08.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:08.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:08.096 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-04-25T13:18:08.120 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-04-25T13:18:08.137 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:08.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:08.161 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:18:08.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:18:08.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T13:18:08.201 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T13:18:08.202 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/remote/smithi155 2024-04-25T13:18:08.202 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:18:08.234 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467/remote/smithi191 2024-04-25T13:18:08.234 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:18:08.266 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T13:18:08.266 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:18:08.270 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:18:08.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T13:18:08.326 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T13:18:08.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T13:18:08.339 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T13:18:08.339 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:18:08.341 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:18:08.353 INFO:teuthology.orchestra.run.smithi155.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:18 /home/ubuntu/cephtest 2024-04-25T13:18:08.370 INFO:teuthology.orchestra.run.smithi191.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:18 /home/ubuntu/cephtest 2024-04-25T13:18:08.371 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T13:18:08.383 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T13:18:08.413 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T13:18:08.438 DEBUG:teuthology.nuke:shortname: smithi155 2024-04-25T13:18:08.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:18:08.461 DEBUG:teuthology.nuke:shortname: smithi191 2024-04-25T13:18:08.461 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:18:08.464 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.235102', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF/saQmDJyV2hS47JOvNhUK4ffFhbtlhuMj+u3WOLqaqROWnhhuVK4hKnZtmDissiHHtT1DgSRmETNEquqgBGlA='} 2024-04-25T13:18:08.485 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:03:59.236532', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIS6BIKUzRV+LkT9bLLyOgodTaBBUm/F+1prQJl0xUcFFLpHOJCtUyjVr+nQBmNkQaAQfnk8zmG0nLB+lnQRl7o='} 2024-04-25T13:18:08.516 INFO:teuthology.orchestra.console.smithi155:Power off 2024-04-25T13:18:08.517 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T13:18:08.539 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2024-04-25T13:18:08.540 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:08.555 INFO:teuthology.orchestra.console.smithi191:Power off 2024-04-25T13:18:08.555 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T13:18:08.564 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-04-25T13:18:08.577 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-04-25T13:18:08.577 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:08.599 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-25T13:18:12.565 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:12.600 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:12.675 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-04-25T13:18:12.709 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-25T13:18:16.678 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:16.710 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:16.790 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-04-25T13:18:16.820 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-04-25T13:18:16.921 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-04-25T13:18:20.794 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T13:18:20.904 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-04-25T13:18:21.005 INFO:teuthology.orchestra.console.smithi155:Power off completed 2024-04-25T13:18:21.110 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 506.7158169746399 failure_reason: '''NoneType'' object has no attribute ''get''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4f0c8adf883146ce8a9f49292454cb5b status: fail success: false 2024-04-25T13:18:21.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:18:21.197 INFO:teuthology.run:FAIL